Yup. I think many are making that mistake. In 200,000+ years all sorts of isolating occured.
There were recurring glaciations ~ Neanderthal populations really had a tough time moving around Europe ~