So long as answering the question is voluntary, there is no problem. None at all.
If you refuse to answer, and the doctor records that as a "yes", then you have participated. (Otherwise, why refuse? Not answering is an answer.) There is no voluntary participation once you are asked.