To cite that case is a straw man, non-seq, as it says nothing of the circumstances I described.
Here is what the Supreme Court has said on that subject though:
"An ex post facto law is one which renders an act punishable in a manner in which it was not punishable when it was committed. Such a law may inflict penalties on the person, or may inflict pecuniary penalties which swell the public treasury." - John Marshall, Fletcher v. Peck, 1810
In other words, ex post facto laws work both ways, their only criterion being that they alter the manner in which a given act is punishable from the time it was committed.
Story's Commentaries echo this sentiment:
"§ 1339. Of the same class are ex post facto laws, that is to say, (in a literal sense,) laws passed after the act done. The terms, ex post facto laws, in a comprehensive sense, embrace all retrospective laws, or laws governing, or controlling past transactions"
Also, check in your own case of Calder v. Bull. You will find the following, which specifically mentions a certain type of Ex Post Facto law that lessens a punishment for an offense:
"All the restrictions contained in the constitution of the United States on the power of the state legislatures, were provided in favor of the authority of the federal government. The prohibition against their making any ex post facto laws was introduced for greater caution, and very probably arose from the knowledge, that the parliament of Great Britain claimed and exercised a power to pass such laws, under the denomination of bills of attainder, or bills of pains and penalties; the first inflicting capital, and the other less punishment."