To which you replied:
Hey, I have a bunch of rocks over here. They are all from moon. Prove that they aren't.
A trained geologist can identify lunar rock by examining the chemical composition, the ratio of elemental isotopes of the sample, the texture of the mineral, etc. All of these factors are characteristically different in lunar rock than from terrestial rocks. Using such techniques and by comparing samples obtained from the Apollo missions, geologists have been able to identify that some meteorites are made from lunar material; meaning they were blasted off the moon by meteor impact, and the ejected moon rocks were trapped by the earth's gravity and landed on the earth.
How does he know? He has to have lunar rock in the first place. I say no one has any.