He prayed not as President, but as Thomas Jefferson, private citizen. While President, he refused to issue official proclamations calling for days of prayer and thanksgiving.
Yet he attended church on public property, the Capitol building.
What you wrote doesn't chage my point.