Wow, interesting if not great observation. Thanks.
The only president to serve two separated terms was Grover Cleveland. His second term was not particularly successful, and he did not have the handicap of being a lame duck.
https://en.wikipedia.org/wiki/Presidencies_of_Grover_Cleveland#Historical_reputation