That's not a subsidy.
People act like taxes are a given and that exemption is getting something from the government.
It seems, though, that in the early years of our country, tax free was the norm and not considered the same as getting from the government. That twisted reasoning only came about after the government started taxing the socks off everything that moved and breathed, even if it was illegal, as in the case of income tax.