I think its origin is in jazz clubs where patrons would stay so late they couldn’t decide if they wanted supper or breakfast.
I played many a gig in the Savannah-Hilton Head area where breakfast was served at about 1 AM.