No, it's always (well, since the 25th was ratified) been the Cabinet.
Only way the cabinet turns on him is if they realize their families can’t all fit in the bunker with Obama and his family...