Well...if one wants to devote the whole of one's being to education--i.e., plumbing the depths and scaling the heights of the greatest questions asked by the greatest minds of the human race, must one not be willing to give up one's family to have the time to do so and be willing to question the dogmas of particular revelations?
Perhaps so, but that is NOT what Rousseau was talking about.
He posited that in order for one to "grow" good citizens one must have the ability to rid the "students" of ANY distraction they might bring with them which might prevent them from putting the interests of the state first in EVERY case.