I used to think that as well. Upon reflection however, Congress is the supreme branch. It can remove justices and the president from office. The other branches have no such power over Congress.
judges can rule however they wish on elections and can remove whomever they wish by how they decide.
And a president can literally jail congress to keep them from voting against him and they will build statues to him like Lincoln did.