If I'm a business owner I have to make X dollars for it to be worth keeping my business open. Businesses are not charities, and no one goes into one to jsut break even or take a loss.
So if you raise my costs, then I have just a few solutions. Cut other costs like labor and production, or be forced to charge more, both of which could put a small business owner in a bind, as corporations are able to cut costs through economies of scale, outsourcing, etc.
So really, it's small business you're hurting.