Humans that fall within the broad range of variation of the existing normal human population. Neanderthals in general fall outside that range. Were they a different species? Hard to say, but probably not, at least not by the normal biological species definition.
You appear to expect humans to wear a bar code defining them as either human or not human. Biology isn't like that. Categories are fuzzy.