Lincoln was the first President to openly ignore the Constitution while in office with his denial of Habeus Corpus. It had to start somewhere and I guess Lincoln was the man.
Not only that, he had a Democrat Congressman from Ohio arrested (and deported to the Confederacy, which sent him back) for opposing his policy.