Hoover, Bush Sr. Carter. Four if you count Ford
I count Gerald R. as just the tail end of Nixon’s second term but you can make a good case for him the fourth, I suppose.