In 1872 Congress rejected both Louisiana and Arkansas electoral votes. This was due to the turbulent conditions of Reconstruction, along with various irregularities and allegations of electoral fraud.
See footnote 2. An outlier, not the norm. Those two States weren't disqualified from voting as you can clearly see since they still cast their votes.