He was ALSO saying that it is and has been the stock in trade among black comedians and that if such talk is forbidden/allowed to one set it should also be forbidden/allowed for the other.
You wrote this like you assumed I would disagree with it. Sorry to disappoint.