Actually, he did. 30 judges have reviewed this case, and say he did.
There were probably 30 judges who thought Dred Scott was just fine, too.