No, “extramarital” literally and generally means “outside marriage”.
It doesn’t mean 1 WAS married, or any such thing. It means outside the condition of marriage.
IOW, anything not strictly within a single marriage can be “extramarital”.
That's how I use the term, but I don't usually argue over words.