I think he believes some, if not a large majority, will refuse to enforce the law, thus weakening him beyond repair.
These judges have no say on this. It would be similar to a judge blocking a Trump appointment, because the judge didn’t like the person.