I did that with my son, too, only it was the Link adventure game. We would sit for hours trying doors and tunnels, trying to find hidden things. Great fun!
The Link Orcarena of Time N-64 game has also be rereleased on the Game Cube.
When I got Zelda for the original Nintendo system, my then-ten-year-old son wasn't impressed. It hooked me, though. So, he would go into his room and I would stay in the living room playing Zelda until I came upon a monster that I just couldn't beat. Then I'd call him out, and, of course, he would defeat it easily.
I've been a Zelda fan ever since, and I'm anxiously looking forward to the new one.