Well, there was one in the 1700s in VA... though he converted to Christianity : Selim the Agerine
How he came to be in the back woods of Virginia was known only to him, though, so everyone had to take his word for it. A hunter found him, starving and bedraggled and perched high in a tree; at first the hunter thought he was some kind of previously unknown animal but soon realized his mistake and after feeding and tending to him, led him back to Augusta VA where he was turned over to the local preacher who could speak a few languages in the hopes of figuring out what the guy was saying- according to old family history - but here’s a more recent story on the guy:
Colonial Virginia gentry embraced stranded North African
http://www.dailypress.com/features/history/dp-nws-selim-the-algerine-20130429-story.html
Obviously by their reaction and that of other colonists around the region, they were most certainly not accustomed to meeting muslims. He was quite the novelty- as in very, very, rare.