Maybe not. Japan has never recovered from its real estate bubble in 1989. But then Japan has a declining population. However, the US has a zero population growth if you exclude immigration.
Without the Hispanics, our birthrate would be around 1.8, but our population would not decline for another 20 years or so, if there's no immigration at all.
Why would you do that? Doesn't make sense to me.