Sure, but each of them is motivated to stay exactly where they are and walk the line for both positive as well as negative consequences.
The negative consequences are death and blackmail.
The good news is, anyone who’s being blackmailed can also be freed from that state of slavery.