As others have pointed out, the argument for the Government is usually made by the Solicitor General or his staff, but the Solicitor General's office is part of the DOJ. Occasionally, the Attorney General himself will argue a case instead of the Solicitor General.
What if the WH doesn’t agree with the law being heard?
Do they still have to file an Amicus Brief?
Or can they stay away?