The Catholic Church historically opposed slavery. Some Catholics didn’t.
Given the extent of it, and how many slaves Spain and Portugal in particular used while colonizing Latin America, it went beyond individual sin.