I've heard the same thing however the police love this particular urban legend. Nothing gets a suspect singing faster than the threat of being raped in jail.
I'm sure it does happen depending on the jail but if you put many criminals together in one location you're going to experience all kinds of crime, rape being one of them.