He was a Quaker. They were very much involved in the Abolitionist movement, so not very likely.
He evidently was a holder of a small number of slaves:
https://www.inquirer.com/philly/opinion/inquirer/20101220_Slavery_stained_some_unlikely_founders__too.html
I don’t believe that warrants removal of his statue or the replica of his house.