Because fundamental rights - many of which were recognized in the BOR - existed long before the BOR.
Those are rights. Why in the world would you think Article IV, Section 2 -- which only mentions privileges and immunities of Citizens of the states -- would encompass ANY rights?