One could spend a LOT of time 'apologizing' to those who take offense at almost everything.
I think that the key is whether you feel bad or guilty about an action. I agree with Francis that feeling guilty is a good indication that you have done something wrong. I just disagree with what makes you feel better about it.
And yeah.. people who are easily offended should just be ignores