If they did have sex and the off spring were like mules and couldn't reproduce this could, in part, account for the extinction of the Neanderthal, however there would be no way of proving this because the DNA would have been lost.
Yes he’s drawing a conclusion with a complete lack of evidence. There are no hybrid fossils either. All the suspected hybrid fossils have turned out to be modern humans.