No there were rumors of it but no ever proved it and no one ever dared to say while he was living. It's only after the old time actors, like Randolph Scott, John Wayne and Cary Grant die and can't speak for themselves that people start these rumors.
There were rumors that Wayne and Grant were gay? That's too far fetched even for Ken Anger...