Rumsfeld was the one to make the bad military decisions. He's still around.
Getting rid of him would be too much of a loss of face. Any objective thinker realizes what a bad mistake the whole thing was and is.