Exactly. If they ask, tell them no. If they refuse to hire based on that, I didn't want to work there anyway.
The reverse holds true if I am currently in a position with high pay but no opportunities for advancement.
It's no coincidence that the wealthiest people in private industry got rich by working outside this stupid bureaucratic idiocy. I know a guy in my industry who has done very well for himself. He's started about a half-dozen companies, then sold them a few years later before moving on to his next one. I once asked him how he knew it was time to sell a company and start over, and he said: "When I get big enough that I need an HR department."