I still reckon the sex-slave theory sounds better...
Muslims in Australia (from an islamic website)
The history of Muslims in Australia dates back to the 17th century, well before European contact with the mainland. The Makassan traders from Indonesia had a harmonious relationship with the Indigenous people of northern Australia.
The early fleets of settlers also used Muslims, from coastal Africa and the islands and territories under the British Empire, as slaves and navigators.
There were also a number of convicts who were sent to Australia for the crime of disobedience. Most of these early Muslims inter-married with the local community and their descendants were assimilated into the society.
However, in the 1860s a large number of "Afghan" cameleers arrived in Australia to work the camel trains which opened up the interior of the continent.
They also accompanied the great explorers and were instrumental in guiding the teams through the hot and arid terrain. They eventually settled in the areas near Alice Springs and in the Northern Territory and many inter-married with the Indigenous population.
The remains of the oldest mosque in Australia is situated near Maree in South Australia and the Great Mosque of Adelaide was built by the descendants of the cameleers...
http://www.afic.com.au/api10.htm
(I have a dog that thinks he's a muslim, he thinks he owns every tree-trunk he pee's on.)