I never surmised that Neanderthals were not a speaking species, but I am willing to use that contention, however ill-founded, as an allegorical explanation for their inability to compete successfully, and eventually triumph.
Something in their genetic makeup, or social construction, operated against them whether it was speech, memory, or even olfactory insufficiencies (of either type).
Or maybe the Main Stream was just against them.