And whatever you think of the merits of Maher's ramblings, he wasn't let go for the comment, but for the resulting plummetting ratings.
Whether people agree with you or not, they are free to vote with the clicker, and the audience was pretty tiny to begin with.