I think it's more in how the word is used. The a$$-hole is a part of the body too; the disrespectful uses of the word are myriad.
Hmm...I think the proper term for that is "anus." I don't use the word you used to describe that body part.