Guys like that are more worried about their legacy. Both Carter and Clinton are working overtime to fix how history sees them.
He reacted to his defeat for reelection by retreting to Plains, GA and setting up the Carter center. He also withdrew from the Baptist convention and teaches his own superior form of Christianty while he criticizes fundamentalism. So, he is isolated in his own world scolding others.