I’d find his story more believable if his grandson was 96 instead of 46. No great-great-great-great grandsons from wife #1?
Maybe he lost track of that branch of his descendants.