My thoughts as well. Perhaps the answer is that we really don't absolutely own it! Our possession of it is ultimately at the whim of an insatiable government.
If anything, a property tax should be of a non-opressively nominal amount. Or, a pay-for-public-services-as-used system.