There is no requirement that a USSC Justice needs to have been a judge.
James Wilson, the first USSC Justice, had no prior judicial experience. There have been many justices who were not judges. It's a good thing in my book, not a bad thing.
Rheinquist had no judicial experience.