There is a benefit to having permanent bureaucrats. Just like a careerist any profession is better than someone who dabbles in and out. And, if you are going to have turnover in the bureaucracy, they become beholden to their special interest to get the job once the government job is over. It happens now.
No, the only way to curb the bureaucracy is to starve it of money and staff. And limit its intended scope.
In any task, there is a learning curve, and a lot of that learning comes from making mistakes. It would be a disaster to have bureaucracies repeating the same mistake over and over. Anyone who has worked for government can tell of some whopper mistakes that were made, and when they are made in the rule-making process the results can destroy private wealth and liberty.
I was involved in a bill before the Kansas House and in the hearings a member of the House research staff sat at a table next to the empaneled legislators. Every so often they directed a question to him, or he would raise his hand and remind them of something. His job? To provide recollection of past hearings on the subject and previous debates for the sale of newly-elected members. His job was to serve as the “corporate memory” for the Committee. It appears they were trying to avoid repeating bad history. I agree.