It can be seen as assault when you put your hands on another person without consent.
Not saying that is right or always the case, but it can be seen that way in a court.
You should stand up for your employees if they are abused.