The song is sad. It’s about when boys grow up and leave childish things behind. Their fascination goes from Puff the Magic Dragon to Tiffany the Nasty Pussy.
Yes; the song is very sad (IMO).