"A person who wears a baseball cap while eating indoors or wears a t-shirt to a good restaurant is probably someone who wasn't raised right and isn't really worth knowing."
Or maybe they're just embarrased about their bald head??
Anyway, I wouldn't care to associate with people who would think those people are not "worth knowing." So the feeling would probably be mutual.
Jesus seemed to hang out with a lot of folks that the religious establishment (complete with their traditions and dress codes) didn't think were "worth knowing". Knowing what we know now, who do you think it was more important to hang out with in the A.D. 30's: Jesus or the Religious Club?
Doesn't matter. Other than for religious or medical reasons, hats should be taken off in a restaurant.