James Madison was 5’4” tall.
Other short presidents were:
Presidents under five foot nine were:
Rutherford B. Hayes (five foot eight and a half)
William Henry Harrison
James K. Polk
Zachary Tyler
Ulysses S. Grant (five foot eight)
John Quincy Adams (five foot seven and a half)
John Adams
William McKinley (five foot seven)
Benjamin Harrison
Martin Van Buren (five foot six)
Therefore, Madison was the shortest president ever by two inches.