Actually that one has taken a little sip of the cool aid. His parents separated no later than a few weeks after his birth, not when he was 2 years old. Very likely they never lived together.
He was not quite one when his father left Hawaii for Harvard. While it's not yet been determined exactly when he and he mother moved back to Hawaii from Seattle, it was definitely after his father left. His mother left U. Washington after the spring quarter, which would have been just a little after Sr's departure for the mainland. She did not re-enroll at U-Hawaii until fall semester of '63. So where she and Jr wer between late spring '62 and fall of '63 is not known, AFAIK.