That's rather a broad brush statement. To a majority of Americans, they're simply a product of times gone by. A historical bit of trivia.
I can recall having a golliwog as a very small child. I know that I liked it and that I did not associate it with black people. It was not dressed like the one at the top of this thread.