There should be provisions for, well, provisional absentee balloting.
If you can not make it to the polls on election day, due to your job or other good reason, you vote by absentee ballot. Have some sort of random scrutiny. Your story would hold up to an examination by a judge or official.
That keeps it for those who have good reason to know or suspect that they will be prevented from voting in person.
If you request an absentee ballot and want to vote in person, you need to produce your absentee ballot for destruction.
Why not keep the early voting like Texas already has and works with Photo ID checks for everyone participating?