I seem to remember his announcement that he was going to have a conservative TV talk show (mighta Ben FOX, way back when I used to think O'Reilly was a conservative).
Never caught his TV talk show, wonder what happened.
That alone might have had something to do with it. ;)
Actually, it wasn't that good. Pat would get some celebrity in for a 'chat' and that was it. Pat is a nice guy. No confrontations, no politics to speak of, no hard questions. That made the show well, boring.
They tried to make the talk show a show biz show. It crashed big time.