True enough. But the tax system and laws were the enabling mechanism that give this man the tools and opportunity to do this, and the law will protect him from the wrath of the adjacent owners, shielding him from the consequences of his own actions and ultimately imposing those consequences on all of us.
Like KC said, "This is the kind of stupid-libertarian-trick behavior that generates new laws restricting the use of private property."