They weren’t infallible. After all, they still saddled us with slavery enshrined into law instead of abolishing it at the start.
There would have been no USA if the Founders had insisted on an immediate end to slavery.