I agree with you: "Fiscally responsible" is a better term for Bloomberg, et al.
By your definition, though, the Bush White House and Congress are "fiscally reckless". I don't think you really want to fire them all, as your comment about the fiscally reckless would suggest.
They're fiscally reckless, but there's a war on which we have to win, and that is more important than mere money.
I wouldn't put the war in the "fiscally reckless" category. I might put the prescription drug program in that category though. ;-)