There is a long history of men taking women prisoner as sex slaves. The only question would be if it was possible to make Neanderthal women submit to such over the long term
Yes, but Neanderthal females would've been physically as strong as a human male. And again, the odds that Neanderthals and humans spoke the same language are probably somewhere between zero and none. Finally, the kinds of behaviors that are rational and predictable amongst, say, medieval conquistadors or classical legionaries, are hardly identical to those expected of prehistoric subsistence foragers. In other words, keeping a (burly, angry, unintelligible) female slave requires a major devotion of energy and resources.
PS. And yet again, I'd remind you that we do not find mixed communities in the fossil records. Slaves leave behind skeletons too...