We've only been wearing pants for about a thousands years or so. Before that, most everyone wore some type of skirt; robes, tunic, togas, etc.
Never thought of that as popular. Men have always worn skirts asfaik