What nice memories. Baking by smell would work well once you had done it a few times.
It DOES work well. It’s how I make chocolate chip cookies!