That is because of political parties. They are not in the Constitution.
In the early days, the President was usually of one party and the VP was the runner-up, usually from the opposition party.
The P-VP party ticket system evolved later.
Just until Aaron Burr screwed it all up by going for the top job instead of second banana.