Slaves would not have been counted AT ALL, without the compromise that assigned 3/5 of a person for each slave within a given state, which made the populations of most of the slave-owner-legal states artificially larger than they were.
It used to be VERY difficult to become an elector in most states at the time, with requirements for property ownership and literacy standards.
And gender.
Thank you for your important observation!!