They purposely mix the bad ballots in with the good ones as quick as possible. One separated from the envelope, you can’t tell good from bad.
If they have, say 1,000 ballots, and only 500 signed envelopes, isn't that a contaminated vote? Or did they shred the envelopes?