“Porneia” which your translation gives as “fornication” refers to an illicit relationship between the man and woman who divorce, not adultery in violation of the marriage. To read it otherwise would make no sense to the reply of our Lord.
It's not only my translation, it the Catholic Douay translation as well...
Your explanation doesn't make much sense to me...If a man or woman fools around after the divorce then it is adultery???