“Be careful, You might discover some skeletons in the closet.”
Or the woodpile.
An expression you don't hear much these days.