In my opinion that makes him informed about the case rather than biased. I don't think he should have to recuse himself. He should recuse himself if there is something that might lead him to not rule according to the law and the Constitution. Having formed a legal opinion based on the facts presented in the case is not something that should interfere with his duty.
any member of an appellate tribunal is required to recuse him/herself from consideration of an opinion rendered by him/her below.
All the liberals on the court - "make things easier for the terrorists"
All the conservatives on the court - "These people want to kill us"