Smart move... Been there and done what you are doing and it is really nice to be debt free! You want to keep a credit card though, not just for emergencies, but for internet purchases (they seem to be all the rage these days - heh).
That does not mean that you go in debt though, it is for convenience and price differential only. You pay them off every month. Good luck!
Yeah I will probably open a new account with another bank right before closing this account.