If not now, when would it be appropriate, in your view, to hold him accountable?
It looks like you are being held accountable.