How about Social Security for one? The FDA, FBI, DEA, ATF, IRS, Education just to name a few others.
Hey...if libertarians can rid the country of social security, I say get to work. (Good luck. The Democrats control the committees and are reluctant to allow Americans to invest even 5% of their Social Security in the market.)
The agencies and departments you mention are bureaucracies. I assure you, every conservative you've ever met wants to shrink bureaucracy, not conserve it.