The Constitution does not say the President and VP cannot be from the same state. It says that the electors of a state can’t vote for a President and VP both from their own state. Thus, if Trump chose Rudy, they could not win NY’s electoral votes, thereby making Rudy a dumb, but not unconstitutional, choice.
-PJ