Yes — most people of non-Christian faiths will still respect the symbol of the cross used by Christians. Like your Jewish friends who put up a Star of David. They assert what they believe to be a positive thing.
Militant atheists, and self-hating weak or nominal Christians, will attack the cross. I’ve seen too disgustingly many weak Christians, who think it a great offense to get “too religious.” They’ll even display the Christian fish but quail at the cross. But the cross is where the power is. It’s what Jesus did to take our sins away and open the door to giving us new strength.
I hear you, my FRiend.