You’re forgetting that the CIA was headed at the time by a communist, John Brennan.
Likely there are groups, even in high places, who, even in small numbers, control much larger herds be sheer will, and the unwillingness of the larger group to entertain any risk.
Similar to the overall slipping this country has been doing, with only one man willing to lay it on the line, the current president.