Well employers don’t have the luxury to spend a few hours to learn about each candidate, all they have is a few minutes at best, and they use the proxies of personal appearance to make those judgements, fairly or unfairly.
Like I said, the FEAR factor matters.
If you had no competitors for the spot, you might be looked at twice, but being careless in public is a good way to lose out to a competitor.