No of your business means yes to many.
I didn’t care what he thought...I just made it clear that it wasn’t any of his business to ask me what I deemed a non medical question...