Yes, freedom of the one(s) you're changing forever must be a consideration. That's where judgement comes in.
C. S. Lewis likened eugenics to making everyone of the future our slaves. Or making us all slaves of Nature as we attempt to control Nature.
But my opinion is that "Nature" is the Creator, Who has a hand in everything. I'll admit that some of the transhumanists and skeptics such as Michael Schumer might call this magical thinking, but that's the base of how I live and think.
Reminds me of the book, The Stepford Wives. (Talk about scary!)