What about linen? Is polyester racist, too? Wool? Mohair?
Just give it time. The cultural marxists will get around to those eventually. They just need to come up with the right rhetorical position to adopt.