Wolfe went to Washington and Lee. So did I. I can guarantee some of the the fictional college came from his experiences there.
He says in the front of the book where he researched the book, I remember Appalachian State (in Boone, NC) but am drawing a blank on the others. University of Florida might have been one.