I'm sure that's true. But at the extremes there would probably be general agreement. For example, those rare cases where a baby is born with no cerebrum.
We, of course, are more civilzed. For retarded people who live on welfare, most females are required to take birth control pills in order to qualify for housing. I leave it to you to decide the morality of this. It is definitely utilitarian.