I think I would have just sat there in the original room...sipping coffee. When they got around to asking about why I’m not going to a room....I would have responded that I wasn’t white or a person of color...I’m translucent or semi-opaque.
or if you wanted to trigger them, say Not white or POC, I’m Flesh-tone!