I believe the common-sense implied way that most mean when they say they “believe everything in the Bible literally”..pertains to historical events (including the miracles-which only God could preform), not talking about poetry which is obviously (as you pointed) meant as allegory and can be interpreted easily.
I prefer to be clearer by stating that I belief the Bible is historically accurate. There has never been a discovery that has contradicted the Biblical record.