“Why should they withdraw?”
Well, maybe to avoid starting a war. That wasn’t their intention, though, so they did not.
Withdrawing wouldn’t have avoided anything. Doesn’t take a genius to realize that the fire-eaters were hell-bent for confrontation - which is exactly what they precipitated and exactly what they got.