From Exodus 20/8 (partial) -- the third commandment.
No work may be done then either by you, or your son or daughter, or your male or female slave, or your beast, or by the alien who lives with you.
Would you be upset if Harry Potter had a slave or two?