Actually, the first civilization with underground plumbing was the Indus Valley Civilization some 8500 years ago.
More like 3500 years ago for the Indus Valley plumbing.