Most probably yes. While the Germans are excellent at organization. Their atomic bomb project was a disjointed and disorganized affair. Nine different agencies all had a hand in the program. The bureaucratic infighting between these agencies slowed production to a snails pace. Some of the scientists, like Heisenberg, may have been trying to sabotage the project. There effort at A bomb creation paled in comparison to our Manhattan Project.
Hitler and the other top Nazis didn't trust "Jewish physics," and evidently the Wehrmacht came to Heisenberg and the other physicists in 1941 and asked if they could guarantee an operational weapon in two years. They admitted that they could not (even the US missed that timetable by two years), and the Wehrmacht said, "okay, thanks," and withdrew their support. From then on, it was managed as just another research project.
Nobody knew that on our side until after the war, of course. The OSS actually sent an agent into Switzerland to listen to a talk by Heisenberg and assassinate him if the German program was making significant progress. The assassin concluded that it was not, and let Heisenberg go.