Men use to wear suits to baseball and football games
And coaches used to wear suits as well, before the likes of Belichick started wearing sweats.
Just watch Leave It to Beaver.