Taking the concept to the extreme is ridiculous. But the general concept of "that government is best that governs least" is a reasonable one. You just can't be a kook about it.
Agreed. Self-governance does not work well with corrupt people, and when libertarians try to claim that personal corruption is some sort of human right all they do is advocate for a bigger government.