A Neanderthal male would view a woman as an exotic food item and that’s all, none of the primate sex signals would be there. For that matter women scientists have been working around gorillas and chimps in the wild for several decades now and there are no reports of any of them being raped.
OTOH, there are reports of male companions being savaged when they were with a woman who was ovulating.
Chimps are aware of a human woman’s reproductive cycle, and neanderthals being closer to human may get both the ‘eliminate the competition’ reaction the chimps get and the ‘do the deed’ reaction chimps just aren’t close enough to get.
Besides which a surprisingly large number of women don’t report a rape even when the attacker is a member of her own species.