Joe Kennedy was recalled because of his coziness with Hitler and his minions. But, just as bad, is what he did with his own daughter — Rosemary. He had her lobotomized and turned her into a vegetable that had to be institutionalized for the rest of her life. He didn’t even visit her. And he never told Rose what he had done.
Hence the Kennedy clan’s long time involvement with the Special Olympics.