I never found him funny, never. That was during my high school and college days. He struck me as a con man. Someone who never worked hard at what he did. Never paying the dues... but bottom line.. not funny. HIs humor was always to mock the other person. His desk was set up higher than the guests.
Compared to Steve Allen, Johnny and Jay he was an empty suit. Then in his later years, he showed his true colors when his politics seeped into the show.
In short, his high brow humor was for an elite group...not me.
I always saw his as an arrogant New York prick. His "humor" was based on cruelty and I suspect he was the sort of kid who pulled the wings off a fly and thought it funny.
Glad he's gone and soon to be forgotten.
Regards,
GtG