Slavery is incredibly inefficient component of an economic system it is factored into, and when placed alongside a capitalist system, it cannot complete. Back then, and with an agricultural based economy, that was probably the only thing keeping it going.
But at the time, it was a big money maker.