I think obesity could lower the sex appeal and sex drive in both genders.
It depends on if obese or just a basic fat guy. I know one guy who is heavy, but there is something about him that women find attractive. A personality, go figure. :)