Yes you are correct. The point that most seem to be missing is there are two potential events being discussed here...
1. Actual physical changes in the rotation character of the entire planet.
2. A change on the magnetic field of the planet.
One would be catastrophic, two would be a nuisance but not "earth shattering." Since the magnetic poles are established and maintained by the interaction of the solid inner core and the fluid outer core, changes occurring there, (flow rate/direction, inner core rotation speed, etc) would have little effect on the physical rotation of the entire planet.
Essentially, Item two does not cause item one to occur..