It makes sense to me the Vikings would move south primarily because the weather would be better and the land more fertile. On the other hand, finding evidence of them is very difficult in this climate and the forested landscape that existed back then.
Something as far north as Baffin Island strikes me as perhaps a trading or hunting post for furs or tusks.