Sadly, history suggests otherwise. The damned stone was stolen from Mecca by muslim zealots for about 25 years once, kept in Qatar IIRC, then eventually returned. All without ending Islam.
I’m speaking of destroying it, not just stealing it. That stone gets obliterated, Islam goes the way similar to the passenger pigeon — billions of followers one year, in a few years, all gone.