It’s been my understanding that heat pumps are only good within certain temperature limitations.
So the discussion really needs a geography component. In upstate NY, the heat pup can be used 3-4 months a year, April/May and September/October when it is over 40 degrees. Once it's colder than that it doesn't work. It does a great job for those 3-4 months though.
That used to be true, but the latest heat pumps will work find heating a home down to an outside temperature of -10° F. That's still most of the country.