The problem is, what happens when Trump is no longer in office.
But the Left already abuses power any number of ways and gives us no recourse on correcting it. Obviously, the only way it cannot be abused is if we elect more principled conservatives after him. But this is also true on 100 other issues so it really matters not what one more change happens.
Your question is like "what if we elect the next Stalin after he leaves office?"
We can't make policy based on worst case scenario.