that was my though also; continental drift over 10 million years can move a plate thousands of mile, enough to rearrange ocean currents and resultant weather over the land masses..
however, the simple explanations are the best; they cause the most panic among the easily impressed.
They say the rate is about as fast as our fingernails grow (about 2 in/year). Or 1 mile in ~30,000 years. That's surprisingly fast, considering we're talking about entire continents and tectonic plates.