I'm in that camp. Except, I don't think God recognizes "time". Time is a human invention to describe and measure. Animals don't understand time as they are not aware of their existence beyond their immediate health, well being and/or danger. How long is a day for God? How can time be measured in eternity? Where does it start and end? Evolution certainly has some convincing aspects and I do believe there is something to it. There are species that are obviously the same with some significant differences. Birds, rodents, etc. The same can be said of human "evolution" in only the past 5K+ years. Humans were generally built different than we are today. Life expectancy is different. There are cranial and skeletal differences that can be measured. And there are certainly differences between humans that "evolved" in differing hemisperes. Asia? Africa? Europe?
All that said, I agree with you, the allegorical nature of God's message to his people certainly was framed for the level of development they were at when his message needed to be conveyed. The earliest people did not read and write. They taught and recorded history through stories passed from one generation to the next. They certainly were not capable of grasping astrophysics for a complete understanding on how God created the universe. Simple and symbolic explanation was in order for his target audience. Eventually, somebody wrote it down. Then it was translated for a few years over and over again. But the message was still there.
I can live with however God did it and not have my faith shaken. Shazam or Evolution? I don't care.
FWIW, according to Genesis 1:5, before God created the earth, there were no days. He created time along with space and matter all on the first day. And He took 6 days to complete his creation, instead of doing it instantly, so we could have a day of rest. In case you are persuaded that he took billions of years to do what he plainly claimed was 6 days, reckon how plants survived without the sun, or CO2 generating animals, or pollinating insects? And why did He reiterate 6 days in exodus 20:11, the 4th commandment?