I can't say you're wrong about that. Perhaps you have a source that I've never seen. But having been around back then, abortion was simply not an issue that was part of the discussion.
Ben Bradlee of the Pentagon papers fame and Woodward and Bernstein Watergate fame.
While JFK’s sex partners got abortions, his friend and neighbor Ben Bradlee of Newsweek and later editor of the Washington Post said that JFK was pro-abortion and quoted him on it, in 1963 JFK privately “said he was all for people solving their problems by abortion (and specifically told me I could not use that for publication in Newsweek)...”