This was circa 1960, when travel between the USA and Cuba was, to say the least, HIGHLY scrutinzed. NO ONE could have made trips between the two countries without the awareness and at least explicit acquiescence of the CIA.
While Rafael manages in "conservative" media a TOTAL lack of scrutiny (same as Obama's fathers, whose son like Rafael the Younger used an alias, and like Rafael the Younger entered the country illegally, and is foreign born to a nation to whom he holds allegiance), THIS bears some research. SOMETHING was going on. The collision of history in the cases of both foreign born Manchurian Candidates---Barry Soetoro and Rafael the Younger---creates to many questions, which, as with Obama, virtually no one in media will TOUCH. Rafael the Elder abandoned his family (as did Obama's father), Rafael the Elder was an alcoholic. What was Rafael doing in his absence. And why did they flee to Canada. So many questions. How did either Obama OR Rafael the Younger afford to attend and reside at PRINCETON AND HARVARD?? Just one of many, many questions. How did either zoom up from minor local bureaucrats to less than one term as senator and then seek the presidency??
I think you forgot that both parents were bigamists.