And the banners' arguments amount to rationalizations to escape the reality that they wish to control others.
When some people show that they possess wrongful attitudes which endorse moral wrongs like using other people as slaves, using other people as though they were sex toys, etc., then yes, those people with the bad attitudes must be prevented by society from acting upon their wrongful desires.