“back in the 1930s. However, USPS didnt exist then!”
This little factoid says differently.
Oldest Post Office is in Castine, ME. This office has been in continuous operation since 1814.
http://www.usps.com/communications/newsroom/postalfacts.htm
http://www.usps.com/postalhistory/postal_service_begins.htm
See: http://www.usps.com/history/history/his3.htm#SERVICE