You do, however, care about your army, the training you’ve invested, the equipment, the ability to take and hold land, to project power, the ability to garrison, and the ability to prevent attacks.
Even if you don’t give a toss about the populace, you do care about your investment.
A sane person does.
Iran, North Korea, and a few others don’t meet that qualification.