I attend a Catholic Church gthat I have been a member of since I went to college. It is largely moderate to conservative but there are some real lefties floating around. I hope I am never held to answer for them.
If your church leaders have sermons that preaches the virtues of the white race, the scourge that is called the black race and honors KKK leaders, then I don't see why questions can't be raised by people about your continued church membership over a 20year period.
I'd say at the very least it indicates what type of character you have. If you were ever offended on a continuing basis you would leave that church and find another. Would you not?