The government putting up a plaque of the ten commandments or statue of Moses is not necessarily endorsement of religion, any more than posting Hammurabi's law. It is a nod to history, specifically the history of government.
Since atheism is a religion, this is ultimately a hypocritical and puritanical approach. The government spends a lot more money and resources "endorsing" atheism, something religious people find offensive. The people who do the most to endanger the first ammendment aren't baptists, they are secular humanists.
The first ammendment is about secularizing government, not stamping out public religious symbology.