This is exactly what happened in Arizona. And here, you have to sign the envelope so your signature can be verified. The signatures on the envelopes didn’t match on thousands of ballots here, but the Maricopa County Recorder verified them anyway and, once the envelops is separated from the ballot, there is no other way to verify the validity of the ballot. That is how Sinema won.
And probably all the supposedly close races