You make a good point. When I go walking and want to listen to music, I use a single-ear earbud, with the sound low. That leaves one ear for the outside world.
I got my single-ear earbud from Amazon.
Keep the sound low but keep the earbuds on in urban areas—when the panhandlers approach and start talking to you just point to the earbuds. It works!