No, you would not. You'd be arguing with yourself (which is entirely your perogative, of course).
"We'll simply have to agree to disagree, then" means precisely what it says: no more, and (certainly) no less. Any mistaking of this simple phrase for an invitation to debate the matter further would be, I'm afraid, a demonstrable error on your part, and no business of my own.