I think the vote would come before the new Senators are sworn in.
Depends on when teh electoral votes are counted. Usually, the new Congress does that as its first act. Thus, the new Senate would vote on the VP, with Biden presiding.