The early Romans were a pious people, though pagans. I’d say what ended their empire was something more like globalism and diversity. They abandoned their identity, their nationhood.
If there is no God, then God wasn’t involved in the fall of Rome.
If God is real, then he controlled the whole thing.