Our species can survive in the middle of the desert and the in the frozen north. I think we would be kind of hard to wipe out. Sure, changing conditions could wipe out a great deal of us, but we don’t need that many survivors to start all over again.
Slow change can also lead to non-viability and extinction. :’)