It is true that men are visual creatures.
However, There is visual for fornicating, and then there is procreating and the two may not be synonymous.
From experience, the ones who are appealing for fornicating are not the ones you would like to be the mother of your progeny.
Which may explain why so many men used to have mistresses. No one woman filled both functions.
An explanation, mind you, not a justification.