Who said I'm attacking them? First of all, much of this is well-known history. However much you respect them as founding fathers, it is inaccurate to present them as moral exemplars. Frankly, the fact that not all were saints gave them a far better understanding of humanity than they would have otherwise. It leads me to respect them more than I would otherwise.
As for abortion in general, my objection is not to you being down-the-line pro-life. My objection is to defining a religious, morality-based conservatism as the only true conservatism.
It is not. There are other types of conservatism and other concerns that people have. And, frankly, my personal study of history leads me to consider religious-based conservatism to be rather out-of-line with the intent of the Founding Fathers.