There is a stone fortification on the south coast of Middleton, RI that is attributed to the Vikings. It was there long before the Pilgrims landed at Provincetown, MA.
They have never been able to prove it. However, they know the English did not build it and neither did the Indians.

Look here.