The only country that did not rely on horses to some extend was the United States. We were fully mechanicizedby 1940.
The British army was fully mechanized too. The Germans took 600,000 horse into Russia. They had one cavalry division which screened the Pripet Marshes. The red army created mech units mixing cavalry with light armor after the initial loses during Barbarossa.