Well, sure! One of them just whispered "Bill, I think you're a swell guy." Or wait a minute, maybe it was "The milkman must die." Dang it, and I just got the hatchet clean.
You'll be fine as long as you don't give them any reason to make them angry