It would have been perfectly fine if this was done to flip an R seat to D.
The sin was in causing a D to lose their seat.
How do they know he took away Democrat votes?