It must be more daunting to have a huge number of records than a huge number of books. No matter how fast you read, you can in principle read faster, so even a rather large collection is within the potential reach of a human life, even if you read slowly for now.
Records take a well-defined amount time to listen to properly; once they add up to more than the longest human life span, you know you'll insult at least some of your collection by never once listening to them.
One collector was also a shop owner and made a good dent into trying to obtain one copy of every record ever released. I think his store inventory alone was something like 250,000 records (don't recall his personal collection number).
And despite the range of my book collection I still continually spend the bulk of my leisure reading time on a short list of books/authors: The Bible, Homer, Virgil, Dante, Aquinas, Shakespeare, Holderlin and Joyce.
LoL thats a lot of music. Say 50*365*24 or 3-400,000 cds or records for half a century. So far I am safe.