With a $10 monthly subscription to a music service like Spotify, Pandora, Apple Music (and a number of others), you will have unlimited access to pretty much everything that was ever recorded. You can stream it or download it to listen to offline (the mp3 files will continue to work so long as you keep up with the subcription).
If you really want to be a cheapskate, just go to YouTube and not only will you be able to stream just any album or song but you can also access countless live performances of just about any artist.
For most of my adult life I bought albums on physical media starting with the LP format, a few 8-tracks, then cassette tapes, compacts and finally mp3s when they were initially only available for sale. Some of the classic albums I kept rebuying as the physical media changed. It depresses me to think about the money I spent over the years purchasing music. It averaged way more than $10 a month, that I can tell you!
I can only play radio or CD in my van. That keeps me buying a few things and borrowing others from the library.
My understanding is that classical music suffers greatly from downloads and compressions. Complex note patterns are lost. All my classical and traditional music, anything where melody is important, I purchase on DVD