I'm still on first marriage as is my husband. And we use "pet names" in re: to each other all the time. We just make sure they are positive. I would never hesitate to call him "sweety" in public at all. And he if objected to that, I feel I'd certainly have cause to be angry with him.
SoS