Even if that were the case, the government should collect taxes from some business, but favor others?
These tax incentives punish business that have been paying their fair share. It's like the guys who turns his back on a dutiful wive who has been supporting him and putting up with his cr@p for years, and then the fellow buys a big diamond necklace to the new floozy who showed up.
And as stupid as well - how often do we hear about taxpayers getting shafted when these businesses take off after sucking up the fat subsidies?
If you like welfare, then you like big taxpayer subsidies.
No free market person would like this.
In the real world cities, states, and countries offer incentives and advantages to attract new businesses. It is the way the game is played. Getting on ones moral high horse is a losing proposition. For example, there are reasons why many businesses relocate from CA to TX.