Cap Anson, who started the color barrier is more notorious. Enos Slaughter (who spike Jackie Robinson in the Achilles tendon @ 1B , a cowardly move) was much reviled.
Slaughter (later) claimed that he wasn't one of the Cardinals involved in the aborted Robinson strike, denied spiking Robinson on purpose, and denied being a racist.
Who knows.
But he was tough to get along with by everybody.