The radical Republicans acted in response to southern attempts to reinstate slavery.
Of course it would have been nice if the southerners didn’t attempt to reinstate slavery. It would have been if they hadn’t started the war to start with.
Once they did one, the logical response was the other.
Which is why Lincoln getting killed was very bad. If he had lived, reinstating slavery wouldn’t have been an option.