Well.... there's this thing called cash. And another thing called checks. They're kind of old fashioned, but they work.
Use the envelope system and a budget. It worked for Dave Ramsey.
Thanks for the sarcasm, it added a lot to the discussion.
I'm a graduate of Ramsey's Financial Peace University, but I've found that having cash on hand (even in envelopes) is a bad idea for me. The debit card works just fine. My bank, USAA, has excellent service in this area, so it's really no problem, just a minor hassle.