I would suggest that your definition is way too narrow. What you describe might be more appropriately defined as "fiscally responsible," the antonym being "fiscally reckless". By your definition, a "fiscal liberal" would be someone who promotes deficit spending. Frankly, I consider anyone in that category as simply unqualified, not liberal nor conservative.
I agree with you: "Fiscally responsible" is a better term for Bloomberg, et al.
By your definition, though, the Bush White House and Congress are "fiscally reckless". I don't think you really want to fire them all, as your comment about the fiscally reckless would suggest.
They're fiscally reckless, but there's a war on which we have to win, and that is more important than mere money.