Actually, it’s the house and senate that would need to confirm a new vice president. And that would not happen until well after the election.
If Kamala moves up to acting president, we likely would not have a new vice president until inauguration day
But would Mike Johnson fill the role if VP until one is approved by Congress?