Given that he waived it for Mueller, I don’t know that he can invoke it now.
He waived it for the Special Council appointed internally by the DoJ in a counter-intelligence investigation.
What we're talking about now is separation of powers. White House Council doesn't testify about presidential conversations to Congress.
-PJ