That's pretty much the subtext of the Stephen King movie, "Hearts in Atlantis," though the short story it's based on is a little more complicated/nefarious than that.
Hearts In Atlantis ... loved that movie. Anthony Hopkins is one of the most talented actors I have ever watched.