It seems possible to me that some drunken 15 and 16 year olds were goofing around, and thought it might be fun to wrestle a girl. They had no intention of raping her, just playing around, hoping to get a feel or a few kisses.
And I also find it quite believable that Ford pretty much forgot about the incident, but as she became a progressive radical, and saw the rise of Kavanaugh's career (who she had heard of in high school), put the two together in her mind.
It might be interesting to hear the full story from the two men. They might very have know the details that have been missing, such as, who owned the house.
Lindsey Graham just said one of the men is “looney tunes.” The other one has been interviewed twice.