People can come up with all sorts of justifications for their actions. “Survival of the fitest” was never meant to be a model for human behaviour, it is simply a description of how nature works. You can’t argue that an idea is invalid because some people have chosen to misuse it to justify their actions.
Perhaps not, but I *can* point out that it HAS led to those actions.