Josephus writes that the Temple was set on fire by the Roman legions who disobeyed Titus’ orders.
The gold in the Temple melted down between the stones. So the soldiers were then ordered to dismantle everything stone by stone to recover the gold.
By the time they had finished recovering the gold, nothing was left but a field that was then plowed under.
Now THIS makes more sense.