President Truman always referred to Key West as the “Southern White House”. So it is bad only if a Republican says those words. Get a life or move away, preferably the latter.
FDR had his “Little White House” in Warm Springs, Georgia, retreat, as well as Campobello off the Maine/New Brunswick coastline - to which you had to travel through Canada to get to, or arrive by boat.