What about the rest of the Scripture? Is it also non-allegorical? This is quite a fundamental question, because if the answer is "no", then please explain the cherry-picking of the fragments that should be read literally. If "yes", then please explain the passages implying the flatness of the Earth, and the Earth being the unmovable center of the Universe.
This is a good explanation:
Myth 7: Creationists Have a Narrow/Literal View of the Bible
This is only partially true. Creationists believe that the Bible was written to be understood. And since we believe that God cannot lie and gave us the Bible to instruct us, we also assume that His Word is clear and accurate. In other words, there’s no reason to think that someone needs to “read into” what the words actually say.
On the other hand, the Bible is not written in one particular style throughout. There are a variety of styles, including historical narratives and poetry. Beyond that, the people God inspired to record His words employed various figures of speech. Jesus Himself was adept at hyperbole and parables, for example.
Thus, creationists approach the Bible in a straightforward fashion. We don’t take idioms or poetic descriptions literally; we see them for what they are. We also do not ignore the intent of the text to align with popular ideas or philosophies.
Source: http://www.answersingenesis.org/get-answers/top-ten/myths-about-creation#paginateTop
“For the weapons of our warfare are not carnal but mighty in God for pulling downstrongholds, casting down arguments and every high thing that exalts itself against the knowledge of God, bringing every thought into captivity to theobedience of Christ” (II Corinthians 10:4-5)