Most followers of any religion follow only parts of the teachings. I'd bet if you took a sample set of any members of any faith, you'd find wildly varrying levels of faith. I've known a few Muslims fairly well, none of them pray five times a day, most of them drink, eat meat on ocassion, and shave.
It's the ones that know Islam (and its requirement to kill non-believers or make them pay tribute) and believe it that are the threat, not the non-believers or the lukewarm who just want to live a decent life.
By your description, the "Muslims" you know are bad Muslims, backsliders, sinners. The "good Muslims" do indeed whip out the prayer rug and pray to Mecca's black stone 5X a day. And it is among that group we find our Islamofascist enemies.
This is true. And I don't believe Mecca needs to be bombed, btw. But let me point a big difference here. Muhammad is the key to Islam. In reality, he invented Islam. He is to Islam what the Apostle Paul is to Christianity. The difference, among many others, is that Paul lived what he preached. Muhammad, however made allowances whenever he deviated from the text he claimed was inspired by God. Muhammad was nothing more than a terrorist. This is an undeniable fact of history. Islam at its core is a violent religion and its tradition has been such. That does not mean many have failed to recognize this and still interpret Islam by their own relative, subjective realm.