Yes. While Calhoun was reportedly one of the better slave owners, Elihu Yale was known as a cruel owner. And, Yale was fired from his high post in India for corruption.
So, they should rename the entire university. How about Political Correctness U.?