I think mere "physical fire" is the concept that trips people up. They do not understand the nature and holiness of Almighty God.
The Lord appeared to Moses as fire that did not consume the bush (Exodus 3:1-6). He appeared as a "pillar of fire" to guide the Israelites in the wilderness (Exodus 13:21). He appeared as fire come down from heaven to consume the sacrifice offered by Elijah that the false god Baal could not consume (I Kings 18:36-40).
"See that you do not refuse him who is speaking. For if they did not escape when they refused him who warned them on earth, much less shall we escape if we reject him who warns from heaven. His voice then shook the earth; but now he has promised, 'Yet once more I will shake not only the earth but also the heaven.' This phrase 'Yet once more,' indicates the removal of what is shaken, as of what has been made, in order that what cannot be shaken may remain. Therefore let us be grateful for receiving a kingdom that cannot be shaken, and thus let us offer to God acceptable worship, with reverence and awe, for our God is a consuming fire" (Hebrews 12:25-29)."
His fire consumes all evil, everything contrary to Him.
So hell is a fire, but not physical, that consumes all dross in sinners?