I’m not following you about “the other side.” Rudy would be investigating the DOJ/FBI, not representing them.
If Giuliani was appointed as a special counsel, he'd be investigating the DOJ/FBI as an attorney for the U.S. government in a case where he had previously served as Donald Trump's personal attorney. He can't represent two different clients in the same matter, even if he's not representing them at the same time.