Tough to do in an election year. I heard he said he would like to have a Repbulican replace him, since he was appointed by one (Byron White did the same thing). My guess is between January and June 2007.
It would be unusual to retire before the end of the 2005/2006 session in the summer. If he were to do so then, however, it would be political armegeddon.