This is a total non issue unless some potential Republican voters decide to stay home for the midterms because of it.
If that happens it is a critical issue.
They won't be voting for Trump. They'll be voting for members of Congress, and if they sit home that day, then it should be because they haven't done shit, and have balked passing Trump's agenda.