But now that I think on it, the 50s Chuck Berry song “Sweet Little Sixteen” used the 2 letter abbreviation for Penn - “They’re really rockin’ in Boston and Philadelphia PA”.
Didn’t PA exist long before zip codes? I know Penn and Penna were common, but I vaguely recall PA, too. It’s probably bad memory.