Herbs like rosemary, basil, and many more are decorative, hardy, and can't be beat when $ free and fresh.
Mint grows easily and prolifically, too...as do strawberries.