I am not sure where we disagree.
You summarized it elegantly but I think it is clear the coins were stolen by someone with connections at the mint.
According to the Court of Appeals:
"the Government opted to ignore a federal law governing seized property."
were improperly confiscated by the government in 2004