Sounds like he’s worried.
Well, he has the wise-ass Latina in his pocket plus Kagan, so all he has to do is threaten the other 7.
“Worried” implies he doesn’t know the outcome, that Elena didn’t tell him the results of the initial vote.
I’m guessing it’s 6-3 against him, and he’s mad and trying to intimidate them before the release of the verdict in June.