It may vary by state and jurisdiction, but where I live (in Pennsylvania), assessors only have the right to examine the exterior of the property. You may allow them inside, but you are not required to do so.
Thanks for the post stremba, I am in Pa as well. Just got a school tax bill for over $5100.