Its not racist, however, to them, psychologically, the fact that he’s losing more and more support among white voters at the same time he proposes things they agree with and benefits them (or at least they feel it would benefit them) makes it seem racist. It’s not that they’re arbitrarily saying its racist knowing its not, its that they truly believe it is racist, despite the fact it isn’t.
When a person puts EVERYTHING in terms of race, then that person becomes racist by definition IMHO.
For this reason, the racists are the ones calling racism. For most white people, it isn't about race at all (in fact he is half white). It's about ideology, and two different directions for the USA.