OK, I have smelt them and they were not pleasant. But that was in the middle of a hot, humid NY summer.
When they have a lot of not-too-old rotting veggies compost heaps stink in hot summer, sure. Maybe my memories are just more romantic than yours.