I heard that part: he cited the Brown v. Board of Education court as a shining example of non-judges on the USSC. From what I've read (and I have never read the decision), Brown is badly reasoned -- and has nothing to do with the Constitution, though it's generally granted that the same result could have been reached from the Constitution.
'Men in Black' gives several examples of bad/poor SC decisions.
That is true, the point Robert Bork made in his confirmation hearings. The idea of non-judge politicians on the court does me no better than a bunch of insider lawyers--they all have the whiff of corruption about them.
The only answer is to truncate the court's arrogation of power and return it to its cage, defanged and chastened.