Exactly. On the other hand how do Muslims look? The only way to recognize them is by their garments
Not the only way, but unequivocal.
The nineteen 911-Mass Murderers certainly thought so.
They went to great lengths to "not look obviously muslim." They knew that it might have (justifiably) aborted their Mass Murder plan.