What you are suggesting would not only would disenfranchise the votes of upwards of half the voters who did vote by mail this year, but again would be impossible for all the mail-in ballots already counted by the regular process this year. They have already been separated from any identifying envelope and tossed into the till.
Not all mail-in processes are so sloppy. But the ones that are need to be gotten rid of.