The agencies and departments you mention are bureaucracies. I assure you, every conservative you've ever met wants to shrink bureaucracy, not conserve it.
Then how do you explain Bush ("the conservative") who has expanded every one of those with the help of a majority in the house?