Looks like to me he is undergoing a real step down from the Vatican (actually).
That being said, I have no problem with the Pope living at Castel Gandolfo. It is more than just a home outside the city for the Pope. It also includes the Vatican Observatory, at which REAL science is done every day.
The Vatican houses a wonderful museum of art, collected over the centuries, mostly by donations of the artists themselves, or from people who had bought the art at some point. Many try to say that the Vatican should sell it to feed the poor, but selling it all wouldn't feed the poor of the whole world for very long. The collection is a celebration of the gifts God has given artists and sculptors, and is there for anyone who goes to Vatican City to see and enjoy it, just as they would going to any museum anywhere in the world.