I am sure 1000s of businessmen feel uncomfortable in ties and dress clothes and would much rather wear khakis and a polo shirt, but that isn’t what society demands.
Well where we live I dont see to many fishermen in ties/slacks.
Alot of folks where there PJ pants out to the grocery store.
Not the slippers thank God.
Guess it depends on what society you live in.