"I would not dismiss shifting magnetic fields so quickly. The "magnetic" North Pole has shifted dramatically in the past 40 years. Now it is not situated on the North Pole but is a few miles inside the Canadian border. Ask any Boy Scout leader."
I hate to burst your bubble, but the magnetic North Pole has NEVER been situated at the geographic North Pole. Also, it hasn't moved in the last few centuries and probably not for eons.
Oh, well . . .
You are mostly correct. However, the magnetic north pole does drift just a bit over time. You can get correction factors for compass readings on highly detailed maps, and you will see that those factors vary just a bit over time. But certainly not "radically" or "suddenly"