Yikes, true! When I built a large tool shed for my hobbies, I altered it and built in a back door. Good to have an escape path.
That was very wise of you.