Congress can change the date of the election.
I could be wrong, but I believe the “first Tuesday after the first Monday of every fourth November” is specified by the constitution, so would require an amendment.