Columbus did reach the mainland (in Central America) on a later voyage. Newfoundland is an island, but the Norse explorers did step foot on the mainland of North America elsewhere. The Indigenous People of Newfoundland were very hostile, even without the Norse doing anything to provoke them.
I see; the province is Newfoundland and Labrador, but you’re right - Newfoundland is an island.