You have to do what you think is best. Mr. Ex and I had to do precisely what you described in order for me to stay home with the children and still afford to live a decent life.
We are debating the homeschooling/private schooling idea right now. If we can't afford private school, I will probably end up homeschooling our children. We still have a little time to think about it. My soon-to-be five year old won't start kindergarten until the fall, and I doubt much harm can come to him until after that. At this point in their lives, we are our children's biggest influence.
"we are our children's biggest influence"
Keep it that way. It will not hurt anyhting.
God Bless You!