It is easy to do a google, but being lazy, my memory says the N viets offered to let him go, and he refused unless they let his comrades go too.
That's a 'Duh!' If he was the only one they let go, the mere allegations of cooperation would not only have ended his Navy Career, but relegated him to eventual obscurity or worse. He would have been looked upon as a sell-out.