I don’t think the “Irish travelers” are ethnically related to Gypsies, but their culture is similar.
Charlie Chaplin, it turns out, was born in the “Black Patch” in a Gypsy caravan. But his one comic short that deals with Gypsies shows a beautiful heiress who was kidnapped by Gypsies, and was being forced to launder clothes for a hulking, bullying Gypsy slave driver. Charlie shows up and rescues her, and returns her to her wealthy mother, who rewards him handsomely, and he’s happy to see her and her pretty-boy fiancée reunited. The end. That’s it.
Perhaps he imagined the heiress as someone similar to his real mother, who might have been a Gypsy by birth, and he had a problem with that.