My guess is that Joe's angry that he was forced out.
He's losing his marbles. But at the moment, he knows he's still the President of the United States.
But at this rate, he won't be able to remember his name in November. It appears to me that he's getting worse each say. So they're not able to hide his condition from the American public anymore (obviously).