I didn't see Merle so much as a racist as a totally anti-social southern biker type who hated anyone and everyone who got in his way. He seemed to be able work with the black guys at Woodbury as long as it suited his purposes.
That's a very good point...Merle had a problem with everybody, lol.