Those are rights. Why in the world would you think Article IV, Section 2 -- which only mentions privileges and immunities of Citizens of the states -- would encompass ANY rights?
1. The 1825 Corfield decision for one:
"The inquiry is, what are the privileges and immunities of citizens in the several states?" We feel no hesitation in confining these expressions to those privileges and immunities which are, in their nature, fundamental; which belong, of right, to the citizens of all free governments; and which have, at all times, been enjoyed by the citizens of the several states which compose this Union, from the time of their becoming free, independent, and sovereign."
2. Douglass, 1821:
"...the words "privileges and immunities" comprehend all the rights, and all the methods of protecting those rights, which belong to a person in a state of civil society,"