You can make a stronger argument using the Three Fifths Rule.
.
They are all foreign invaders who are not subject to our jurisdiction.
Slaves were subject to our jurisdiction.
Foreigners not subject to our jurisdiction do not even count for 3/5ths.