Which justice, exactly, said that? I can't tell. There's a quote here from Scalia decrying the term, but who used it in the first place?
Justice Kennedy was the one who referred to the minority justices as “enemies of the human race.”