I dunno ... private detectives tracking me down? To quote Kramer, “I don’t like the sound of that.”
It depends on how they do. For example, if they stop at your house and no one answers a knock on the door, do they wander around the property to see if you're around, etc or go into other buildings on the property?
If they did that, that would be a problem.