I think you are making a too logical assumption. :)
It should be “All environmental wacko theory is built on the idea that there are too many OF YOU people.”
The ones stating the theory don't factor themselves into what they are saying
Good point