Read some of Davis's biographies and the man's own writings and you'll see that the opinion has a lot of basis in fact.
There is way too much historical revisionism in these modern studies. Unless we have a personal statement that Davis considered this servant a non-human I think it’s prudent to be cautious.