That sounds like Harry's villa in the book. He also complains that it it drafty.
That's every stone building in my town and every old stone building in Sicily, and Italy too. They were all built the same way - layer of rocks, slather on lots of weak lime mortar, add another layer of rocks, so on and so forth. There's a reason these places collapse like a house of cards during earthquakes. . .