Actually, it really isn't Darwin or any of his intellectual students that is the problem. It is the socialist/materialist/athiest types that use/misuse Darwin's work to justify their own.
Frankly, I don't see a broader agenda beneath the Darwin thing. I do see a certain amount of fear that ID will degrade the teaching of science.