"It's the number of men who've held the office." One exception. Grover Cleveland was counted twice, as the 22nd and 24th President, because his two terms were interrupted by Benjamin Harrison.
See 1558, I forgot about that.