Actually his problem is that he’s not hard left enough.
Feminist groups are still unhappy with Lawrence Summers, a top candidate for chairman of the Federal Reserve, over a comment from 2005 that they dubbed sexist.
He was the president of Harvard at the time, addressing an economics conference when he made the controversial comment:
It does appear that on many, many different human attributes height, weight, propensity for criminality, overall IQ, mathematical ability, scientific ability there is relatively clear evidence that whatever the difference in means which can be debated there is a difference in the standard deviation, and variability of a male and a female population, Summers said.
http://dailycaller.com/2013/08/07/now-still-doesnt-like-lawrence-summers-eight-years-later/#ixzz2f00t0fAS
The far left still can't forgive Summers for his un-pc anti-feminist remarks while President of Harvard.