Your quote is correct. What saved Cosel was that Muhammad Ali came out and defended him, telling everyone that the remark was not meant in a racist way. It was good of Ali to do that.
Ali was a different person in the 80s, supported Reagan, pretty much left his past behind.