Attorney client privilege isn’t owned by the attorney. It is owned by the client.
Yep, that’s a fact.
And if a client decides to give up the attorney-client privilege, the attorney has grounds to walk away.