This is exactly why, in Atlanta, a lot of open-past-midnight convenience stores require you to be buzzed in through a locked door.
Many 24 hour convenience stores in New Orleans have a bank teller window with a large drawer and bullet-proof glass. You tell them what you want and put your money in the drawer. They slide it out with your change.