Joshua 10:12-14
On the day the LORD gave the Amorites over to Israel, Joshua said to the LORD in the presence of Israel: "O sun, stand still over Gibeon, O moon, over the Valley of Aijalon."
So the sun stood still, and the moon stopped, till the nation avenged itself on [a] its enemies, as it is written in the Book of Jashar. The sun stopped in the middle of the sky and delayed going down about a full day.
There has never been a day like it before or since, a day when the LORD listened to a man. Surely the LORD was fighting for Israel!
I think you're reading more into that passage than is actually there. In common language we refer to the sun moving all the time, even today. Saying that the sun rose this morning isn't an expression of belief that the sun orbits the earth.
Ever been out in the desert where it's very flat? If so, you might have commented on the flatness of the terrain. In reality, the land in question was curved, but to your eye it appeared flat so that's how you'd likely describe it. It wouldn't mean you think the earth is flat if you called a vast desert expanse flat.
The Biblical depiction of the sun standing still is the same thing, it's just describing something as it appeared to the naked eye.
The Bible wasn't written as a science text book so don't get too wrapped up in the wording like "four corners of the earth", etc. We all know the earth is spherical and yet we use this phrase today. To Joshua, the sun stopped in place - in reference to where he was IT DID.
No one is suggesting we use the Bible as a textbook in biology class just as I wouldn't suggest you use a biology text book from 100 years ago. Scientific terminology, technology, and theories change over time and so does the non-scientic. You may not agree with the terminology used by the Bible's writers but the truth is still the truth.