Yes, Australia started as a prison. Or if you want to nitpick...
OK, let's pick nits.
Was Australia originally a British prison island?