That's a complex question, to which probably no one knows the complete answer. Suffice it to say, the deep state has very deep roots.
I agree with you but the real answer is that over time we, the American voters, have allowed bureaucratic agencies to wag the Constitutional dog. When agencies like the IRS, FBI and other intelligence apparatus can thumb their noses at Congress, we should be terrified.