“that at that point in history, the court was going to rubber stamp anything Lincoln wanted”. You opinion only, unsupported by any facts.
I would suggest that the fact they didn't require obedience to Article 4, section 2, and that they didn't require due process for all those seizures is pretty good evidence.