Could it be the case that there are times when the right thing to do is stand up for yourself and not let a bully push you around? I see nothing wrong, especially in politics, with defending yourself against unfair and scurrilous attacks and innuendo, and sometimes that means getting tough with someone who is obviously trying to take advantage of your good nature. There comes a time in most people's lives where, no matter how generous of nature and gentle of heart they may be, they simply have had enough. I am at that point with these people. Maybe you are not (yet). But there may come a time when you will be.
I'll leave it at that. You can have the last word if that's important to you.