In much of the Near East, it was quite a long time after the Muslim conquest before Islam became the majority religion.
It was something like other imperial governments. For instance, it took hundreds of years for Latin to supplant the Celtic languages of the region.