Good they considered Europe a primitive, barbarian, backwater region of earth with no redeemable values, or they probably would have.
Ummm... they tried. In 711 they invaded Spain from North Africa, and held it a good long while. They besieged Vienna in 1529 and 1683. And had they not been stopped at Vienna, all of Europe would have lay before them like meat on a platter.