Yes. With regard to the part of the world you can see. But physicists, in particular, know that there are many parts of the world that are inaccessible, and about which we know nothing. Let's see: what existed before the big bang (and why the initial fireball was at an extremely low entropy), how to explain the quantum world of wave functions, which can't be touched or proved to exist (except by inferrence), and yet which makes up all existence, the existence of other dimensions (now widely accepted part of string theory), the world that may exist in time-like intervals in relativity theory. Neither are physicists good at explaining the existence of the beautiful and complex world of mathematics. Just chance occurrence that the world of mathematics fits together so well and completely? Maybe (but for many, doubtfully). Many people who believe in God infer his existence from other things, and assume that there is more to the world than that which can be measured and experimented with by physicists. They may be wrong. But physicists should be careful that they not limit their thoughts to only that which can be measured directly in the laboratory. Such may only be a tiny part of the ultimate reality.
The development of life on Earth falls squarely into that category.
As for the other topics, I've expounded upon them at length in these threads before, and I don't have the time to reproduce them here. I'll give the short answers:
"Before the Big Bang": geometrically, there is no "before the Big Bang", for the same reason there is no "south of the South Pole".
Quantum Mechanics: it is logically impossible to describe QM in terms of quotidian phenomena like particles and waves, because quantum objects are more fundamental than the quotidian phenomena. Those phenomena are made up of quantum objects. You cannot describe the more fundamental in terms of the less fundamental; this is basic philosophy.
Extra dimensions: these are experimentally testable. Most of my research in physics over the last two years has been to design a machine that can perform these tests.
Mathematics: I agree with you. As a deist, I believe in "God the Geometer". God is the sum of all possible mathematical Truth. However, I have never seen any scientist attempt to make an argument against this (except in defense of a different religious faith).