Prime example - Andy Jackson, and he was president.
My analysis of the incentives under which the Federalists operated did not refer to promoting Christianity but to accommodating already extant Christians. Freedom of speech was already an established principle - but the right to not be lied about verbally or in print - a right enforceable via slander/libel civil action - was also an established principle (understandable WRT the commandment against false witness).