Exactly. I come from very a un-Ivy League background (Southwest Missouri farmer with a State U. degree) but I attended an Ivy League law school. I occasionally felt out of place, e.g. the first time I heard a discussion regarding NYC taxi cab medallions--I didn't know what a taxi cab medallion was. But I never doubted that I deserved to be there, because I got in on my merits--my LSAT and GPA were above the school averages. After a while, I also noticed that my classmates from NYC, Boston, DC, etc. were much more ignorant of flyover county than we flyover types were about the East Coast.
My husband-to-be followed me up there to keep the Princeton men in line, and he amused himself by egging them on and baiting them with outrageous lies. More than one of my friends took me aside and asked me how I could date such an awful man. When I told them he was pulling their legs, they didn't believe me.