What about movie theaters and libraries and expensive restaurants? Should uncontrollable children have the run of them too? I stopped going to my local church because clueless parents would allow their kids to climb all over the pews, throwing Cheerios and squabbling. I found a nice, quiet Latin Mass where parents teach their kids they are in a special, holy place. If you prefer the raucous megachurch style, have at it. To each his own.
Presumably, you matured and your senses became more attuned to the world around you. Either that, or things have started to grate on your nerves.