Then there was Governor Orval Faubus, of Arkansas. He came out second best in a confrontation with Ike, you may recall.
According to his NY Times obit, "After leaving office, Mr. Faubus made sporadic attempts at a comeback, running for governor unsuccessfully in 1970, 1974 and 1986 and spending much of his time as a bank teller in the Ozark town of Huntsville." Nowadays, we have ATMs.
After Ike's inauguration, Harry returned to the White House, picked up his luggage, hailed a cab for he and Bess and proceeded to Union Station. He and his wife made their way through the crowded terminal, then stood on the platform waiting to board the train back to Independence.
They were unaccompanied throughout.