SC justices mostly work alone with their clerks, although there is of course social interaction and some communication, at least between like-minded justices.
During the annual session, they meet once or twice a week in the ‘small conference room’ to review possible future cases, etc.
There are several books on the internal workings of the Court. A good one from 2006 is ‘Sorcerers’ Apprentices: 100 Years of Law Clerks at the United States Supreme Court’.