Drudge is a dumpster diving drama queen
Actually, the last long article I read about him says he bought all the homes around his in Miami ... and that he sits alone in a room watching multiple TV stations at the same time. He does this as one of his employees posts the Drudge Report website with which [supposedly] he is not one on one.
He is said to be a total recluse.
Having said that, I cannot disagree with you and have no idea if the Drudge article is correct.