37% of British Muslims believe it is acceptable to murder their Jewish neighbors.
I agree that Islam is not 100% evil, but a huge minority is clearly evil. Genocide is their program, and the other 63% are not (often) calling them out.
The vast majority of the 63% will not speak out against the 37% because Muslims are not supposed to speak against other Muslims (unless it is Sunnis attacking Shia or Arab Muslims Kurdish co-religionists). Anything that puts Islam in the least bit of bad light is considered bad form. Hence, the uproar over the use of "Islamic fascism," even though the term is entirely accurate.
Even if only 10% globally is into physical holy war (and they can be found across cultural barriers and around the world), that is still 100million+ soldiers.