Also, even the 24 state re-election sweep by James Monroe in 1820 wasn't unanimous-- one New Hampshire elector voted for John Q. Adams and three electors abstained (Mississippi, Tennessee and Pennsylvania).
The very next election cycle (1824) was the first time that elector selection was made by direct popular vote and even then, it didn't become the only method until 1864.
An odd feature of the 1820 election was that the electoral votes from Missouri were counted although its admission as a state was not official until August 10, 1821.