CONGRESS doesn’t have to do anything. The Office of the Special Counsel was established under DOJ regulations, not through a Federal statute. Therefore, it can be eliminated through executive action by the President or the AG.
The Office of the Special Counsel is a legitimate Federal office established by Congress for internal DOJ oversight. This is completely different from a Special Counsel appointed within the DOJ to investigate a specific matter as a Federal prosecutor.