Not all credit card companies are banks. Ever see a Discover or American Express branch?
They're right across the street from the Visa and Mastercard branches.
Unlike MC and Visa, you can actually bank with Discover here: http://www.discoverbank.com/