You would eliminate too many that work for a living. Folks that jobs are not simple 9-5 and always in the same location should not lose their right to vote.
I have voted "early" (usually the last Saturday in October) for about the last 10 years, because it's more convenient than voting on Tuesday. I know all about tough jobs in odd places, prior to the last 10 years I voted absentee regularly because my job.
I STILL oppose easy "early voting" on principle.
"Absentee ballots" should be severely restricted to deployed military personnel and the like who are physically prevented from being anywhere near their polling place on Election Day. That's not what modern "early voting" is all about. Modern early voting is all about making life easier for the lazy.