Hitler actually was indifferent to the Olympics, it was Goebbels who actually convinced Hitler that the Olympics could have tremendous propaganda value for the Nazi regime.
Who knew?