I’m sure this is important to the average voter.
The worst this could be described as is an imperfect turn of phrase. Romney did not put women in binders; he organized their resumes with them.
Obama saying “when I was president” was a much odder gaffe. Republicans are not focused on misstatements as much as factual errors and a poor track record. That Obama’s camp is focused on such a thing wreaks of desperation.