Maybe we Catholics should "boycott" the "holdays" and celebrate Advent and Christmas as we celebrate Lent and Easter. Maybe alms for the poor instead of gifts under the tree. Let the pagans have their Saturnalia.
Not a bad idea at all.
But the flip side of your argument is "Who will stand up and tell the world about Jesus Christ?"