You may or may not know this—but it was LBJ who told Chief Justice Warren that is was necessary to crush any claims of conspiracy for exactly the reason you stated.
Hint: LBJ was lying. He knew it had nothing to do with Communists or Russia or Cuba.
He was scamming Warren.
Do you have a primary source for that? Where can I go to read that myself