I suspect the father’s appearance has some influence on people’s opinions. I must confess, I made several assumptions based on that.
I think they would have completely ignored it had it been a black woman doing that to her child. (i've seen them do that and worse. :) )
So yes, I think you are right.