Your last sentence sums it up. In recent years fewer cities and countries are even submitting bids for hosting Olympic Games. The Olympic Committee simply has fewer places to choose from anymore.
Their fault for making too many demands. So now cities and countries are saying "no".