One needs to consider that as the massive bureaucracy crumbled, warlords rose to power and the Christian Church rose as an institution. My take is that the authority of Rome fell to local power.
The irony is that the barbarian warlords who took power after the fall of the Western Roman Empire considered themselves culturally Roman. The might have usurped the power of the Empire, but the culture they accepted lock, stock, and barrel.