You know if the two species were breeding so much were they really different species? Reproductive isolation is one of the defining characteristics of a "species". I think this supports the theory put forth by some anthropologists that Homo erectus and Neandertals were actucally separate Homo sapien tribes, and not other species. I personally think this throws a monkey wrench into the puzzle that is "human evolution".
But he did contemplate it.