That IS the scary part. You hear of so many little kids found floating in the pool who were out of sight for just a FEW minutes. That would be so horrible. I just can't even begin to imagine.
My nephew just bought a house that had a pool. The people had just built it, then decided to move. He didn't really want the pool, but wanted the house, so what are ya gonna do? It didn't even have a fence yet. He's got a 2yr old that's really a pistol and another one one the way. They're gonna have to watch him like a hawk!
I'd get that sucker fenced in a hurry. My 5 year old is all over the place so I don't even let her go to friends houses that have an unsecured pool.