I have seen several angles of this picture and it just seemed to me that Carter was kind of standoffish from everyone else. If you look at it from the front angle, everyone else is almost shoulder to shoulder and he’s like 2 foot away.
Seeing Carter with all the other Presidents and the P-E, finally brought me to the conclusion that Carter has short man syndrome and that’s why he’s such a jerk!