My husband used to go caving a lot, but he has never taken the kids (or me). I think it would be a lot of fun for the whole family.
Daughter and her high school caving club went to Pettijohn's Cave, which is said to be "the muddiest cave in the Eastern United States." Judging from the state of her clothes when she returned, I have to agree!
I don't do caves well because I'm claustrophobic . . . have never minded heights, clean our gutters from on top of the roof, breezed through the BSA High Ropes Course without a care in the world, but something about being in a narrow crack a couple hundred feet under the ground with all that rock right over my head . . . . < shiver >