This does not pertain to the Electoral College. The day was chosen because the crops were in, people had to travel to get to the polls, Nov. 1 was both a Holy Day and a "bookeeping day".
I do believe this will make this a Constitutional matter in the end...
You're absolutely right. There was narrow window in which to act, after the labors of the harvest and before snow made travel impossible for much of the country. The day chosen had to be sensible for both the Georgia planter and the Maine farmer.