Weaver had plenty of opportunity to have his family surrender to the FBI.
You could also surmise that the Jews had plenty of opportunity to have their families surrender to the Gestapo.
Weaver was a bit paranoid. In this case I'd say the paranoid man was right.