Free speach means you can ban the speach of anyone you disagree with. Campus Groups are under the charter of the University of California which is the 4th branch of the California government under the California state Constitution. You are bound under the 14th amendment to recognize all other amendments.
It's not hard unless you have abandoned the Constitution.
By coincidence, the University of California was founded in 1868, the same year that the 14th amendment was ratified.