Hmm, I looked it up and some sources have “Adam’s apple”. Wikipedia and Medicinenet.com
Guess I never really thought about it and just assumed there would be an apostrophe.
Good grief.