The Black Canyon of the Gunnison, deeper than the Grand Canyon (IIRC), and they used to allow rock climbing.
My wife and I visited that a few years ago and it was awesome. There are hiking trails there where you can walk right off the edge. Very cool, I recommend it.
Grand Canyon is 6100 foot deepest point
Gunnison 2900
I love you he Gunnison area though