“Do you have a gun?”
“Why, doctor! I feel compelled to report to the state board that you have made sexual advances toward me. Any other questions?”
The trouble with that, or any other snarky or evasive response, is that the doctor can put whatever he wants in your medical records and you'll never know. You'll just be a big red flag in a government database. And coming from a family of doctors and having met many doctors through them I can assure you there are a lot of very thinned skinned, egotistical doctors out there. Better to just bite your tounge and say "no".