Then you can probably amend your statement to simply "I don't know too many women who find it very fun."