The shoe may or may not fit, but it was still unprofessional behavior. Prejudicial too.
It did display a certain lack of judicial demeanor, true. But other judges have been just as exasperated at the Birther cases and have let their frustration show. I don't think it's automatic cause for appeal.