I think it's supposedly a building built by Abraham. Tradition holds that the metorite was the first stone he laid. They don't worship the rock.
Google Mecca & Medinah. I need to reread some of that stuff.
Given that Abraham was NEVER there...
I am for destrying the Kasba ASAP...