That’s why God made Styrofoam and Great Stuff, just to solve that short-term problem. It doesn’t have to be pretty, or permanent, you just have to get through the winter, and do it all over again before next winter.
It is going to take more than insulation, it will take a heat source in that space.
Frost depth is typically 4 feet or more.