They wanted a religiously neutral government. You don't get that by forcing various specific religion's icons on people at taxpayer expense. Not everyone believes in the 10 Commandments, especially those commandments dealing with God ("Have no other Gods before me" etc.)
You can get your religion on private property. There is more than enough of it out there.