Years of in-breeding will do that to a family.
Regression to the mean. The same thing happened to the Medici family.