I believe that there is a problem in describing "species." I know that horses and donkeys can produce a sturdy work animal called a mule. Mules aren't supposed to be able to reproduce but, from time to time, they do reproduce.
But, in the case of traditional humans and Neanderthals, I believe that one would have to be very drunk to tie up with one of those.
One common artist's conception has Neanderthal girls not being all that bad looking: