It does not say anything about the babe in the next county.
What about “only have sex with your spouse”?
No, but is does make you go outside the family circle, and this imposes an economic limitation. Polygamy dwindled away in later Judaism, which is why
Jesus’ new law was not an outrageous innovation, but a fulfillment of the rule laid down in Genesis: one man, one woman.