It was harvest failures that ultimately got Khrushchev booted.
Kruschev should never have been in the position. I think it was the missile crisis that closed the door on his premiership.
He was the guy who oversaw the starvation of the Ukraine in the thirties. Lots of grain harvested, little distributed to the Ukrainians. About 7.5 million died. Just a management technique.