ATMs from your primary Bank are the way to go.
Should the nearest [your Bank’s name here] ATM be a bit away, a small stash of ca$h at home will get the job done.
That is pretty much what we do. We go get a larger amount from our bank and keep it in our home. When I need to break a big bill, I go buy a $1 item and get my change that way. I have no problem asking for smaller bills.