You are correct. There are cities that have great water for drinking without further filtering.
Portland, OR is one. I’ve also read that New Your City has great water for drinking because their source is an aquifer that is VERY deep below the surface.
New York City’s water source is a series of reservoirs in the Catskill Mountains.