We had a retarded adult living in my town for the first twenty years of my life. All the little kids played in the park with him. A real ox of a man but about as dangerous as a butterfly. The whole town knew him.
There were a few biggots around who would whisper "You never know what (those people) are capable of."
My best friend's daughter has Down's. I know exactly what you are talking about.