The big problem was that men decided they could do it all themselves (whether as an organization like a church or otherwise) rather than resting directly on the grace of God which was promised to be sufficient without other men pumping it up for you.
The sin is obvious now, but that doesn’t mean sin wasn’t there from the start.