To a lesser degree, there are some on the right who feel the same way, unfortunately.
But it’s damn near unanimous on the Left. Strict libertarians are (unfortunately) not that common on the right, but it’s from the Left that you hear “dey should spend dat money on da people here” etc.
The Left opposes the expansion of humanity into space for the same reason as they hate rural America and want to drive everyone into cities: The more concentrated people are, the easier they are to control.