Check the 12th Amendment - it specifies the VP must be eligible.
I see that now: “no person constitutionally ineligible to the office of President shall be eligible to that of Vice-President.” I guess I usually glide over that amendment, as it mostly corrects the confusing original system, under which I never lived and never studied thoroughly. Except, that is, to gawk at the wacky election of 1800.