If he’s no longer the swing vote, whatever they have on him can’t be used, so he can vote the way he wants.
Great observation. Hadn’t thought about that, but you are right.