You're right about the cold.
I remember being in Alaska in the winter for a family wedding and thinking, "If the power failed for long, all these people would die..."
They do die. There is also the issue of frozen water pipes. They'll freeze before you do. We always shut off the water when we leave home for any length of time in the winter.