Using your math, you are paying $500 a month for interest, which is tax deductable, so say it really costs you about $400. And you are paying $500 a month for your house (does that include taxes and insurance, which would bring it down to about $250 a month, or are you figuring the full $500 for principal reduction?
Now go take that $500 (or perhaps $250) and see what kind of apartment you can rent with that.
And, if you bought that house in 1989, it has probably tripled in value. If you bought it in 2008, it may, depending on where you bought it, doubled in value.
So for less than the cost of a decent apartment, you have an asset which might have been worth $100,000 when you bought it worth $200 - $300,000 today.
Since the mortgage portion is loaded on the front end (your last payment would be almost all principal, the first payment almost all mortgage) You’ve probably milked most of the tax benefit out of the property if half and half on the p & i. If the taxes and insurance are coming out of the non-interest portion, then you probably should let it ride some more.
On the other hand, if you are living in a $250 - $500 a month apartment, you are building no equity, may not be in a position to itemize (unless you give heavily to your church), and you have to worry about your neighbors.
For most folks, the formula that makes the most sense is a 30 year mortgage than you pay off in 15, and from which you get 8-10 years of tax deductions. Then at the 15 years you own an appreciated property (real estate has certainly outperformed gold or oil over the last decade) with the only burdens being taxes and insurance. (And on the insurance, since you no longer have a mortgage, you can assume the level of risk with which you feel comfortable.)
Take as long to think about it as you need.
I am making a paying off your mortgage vs. perpetually refinancing your mortgage for the purpose of the tax deduction.