Men's college? Do they have those anymore?
Only 3 that I know of still exist, Hampden Sydney, Wabash, and Morehouse. Morehouse is traditionally black.
However some would add Jewish yeshiva and rabbinical schools to the list. There are quite a few of those.
My son graduated from Hampden Sydney.