Mark Levin pointed this out a few weeks ago in an interview with a former DOJ colleague. Somebody with standing has to contest SC and Rosenweasel. People aren't going to contest them all the way to SCOTUS without major financial help. Some low level staffer up to debt near their eyeballs aren't going to do this. Manafort is sort of going down this road, but only made the case so far that his case was outside of the Russian collusion scope letter. Not that it is unconstitutional.
I do not believe our founding fathers ever envisioned a special counsel. Hell, many of them were lawyer types also. I firmly believe they felt Congress would do their jobs as opposed to being on the federal employees retirement system and their AFGE union insurance.