The problem is that, somebody will gladly move into that vacuum, do you trust them?
Isn't that how we ended up with Mubarak in Egypt and Khaddafi in Libya in the first place? We decided that totalitarianism was OK as long as they did business with us.