Your experiences roughly paralleled mine during that time period. It is amazing that when set up clean and right that the much lower power hardware we had then had quick start up times and snappy performance for the tasks that we used them for.
I still have a Zip drives and media for them as well. Most of them were 100MB but they had variants that had 250MB and 750MB. I have the Jaz variant and media which have 1GB of storage. I also have the Clik! variant which hold only 40MB but are tiny, barely bigger than a Compact Flash Card. The drive that they use fits in a laptop's PCMI slot. I purchased an expensive little MP3 player that used them. The SCSI versions of Zip drives were considerably faster than the parallel port versions for most applications.
I actually donated a bunch of Zip drive media to the fire department that I worked for. The department used them for a bunch of purposes and when they became hard to find it became a problem. Previous to those drives I had a couple of multi-track tape storage units...
I haven't checked any of these devices out for a long time. The 100MB Zip drives and the Clik! drives are pretty robust but the Jaz drives were expensive and notoriously undependable.
Twenty years later, all that clutter is gone. I have a very thin MacBook Pro, a couple iPads and an iPhone. Also a NAS (Network Attached Storage) unit with 8TB of local storage. This is where I stream my massive music collection from. Also a high speed Internet hookup with a Roku box that drives my one large screen TV - no cable TV whatsoever. Wireless speakers throughout the house.
My only Windows device these days is the Lenovo laptop that work issued me.