If it bothers you, don't use it. But the fact is the origin of X-mas is not from the devil.
"X" is the Greek symbol for Christ.
I generally don't use it because people don't recognize that. Not because it "takes Christ out of Christmas."
Well my Irish mother wasn't Greek Orthodox...just plain old uneducated loving Christian Irish Catholic Mam.
My story was anecdotal.
And no, you are right...Greek or not, I won't use X-mas. Takes all of five seconds to write Christmas.