Should Travelers Avoid Flying Airlines That Have Had Crashes in the Past?

The downing of Malaysia Airlines Flight 17 in Ukraine on Thursday, following the disappearance of its Flight 370 in March, is the second mysterious incident involving the airline this year. The incidents don’t appear to be related, but that isn’t preventing people from insisting that they’ll never fly Malaysia Airlines again. Some of them will follow through — academic studies have found that high-profile crashes can shift passenger demand away from the airlines involved in the disasters.

Is this behavior rational? Should we really be less inclined to fly airlines that have had fatal crashes in the past — even when the crashes don’t appear to be their fault? Or are crashes essentially random events that occur at about the same rate on all airlines over the long run? (The two fatal accidents involving Malaysia Airlines this year were the first for the carrier since 1995.)

We can study this by looking at safety records for major commercial airlines over the past 30 years, as based on the Aviation Safety Network’s database. The method is relatively simple. I’ll break the 30-year period down into two halves: first from 1985 to 1999, and then from 2000 to 2014. Then I’ll look to see whether there was a correlation in crash rates from one half of the data set to the other. If we identify a correlation, that will imply that crash risk is persistent — predictable to some extent based on the airline.

Here’s the data for 56 airlines that were in the global top 100 as of December 2012 and which have operated continuously since Jan. 1, 1985. Airlines are sorted based on the rate of fatalities per ASK.

As you should see, the number of fatalities is not very consistent from the first half of the data set to the next. Avianca, the national airline of Colombia, had a series of major crashes from 1983 through 1990. But it has had almost no problems since then — no fatal accidents since 1990, and no incidents of any kind since 1999. By contrast, Kenya Airways was fatality-free until 2000 but has had two major accidents since then and ranks as the worst airline since 2000 based on the number of fatalities per ASK.

One or two other carriers, such as Taiwan’s China Airlines (not be confused with Beijing’s Air China⁴), have had problems in both halves of the data set. But these cases are more the exception than the rule. Overall, there is no correlation in the rate of fatalities from one period to the next.

Accidents that produce a massive number of fatalities are rare compared to fatal accidents of any kind, however. And fatal accidents represent only about one-quarter of all incidents listed in the database. So it may be better to compare airlines on the basis of their number of incidents, whether or not they resulted in a fatality, which has the effect of increasing the sample size. These near-misses can still produce non-fatal injuries. They may also provide useful evidence about the overall hazard associated with flying a given airline, in the same way that the number of smaller earthquakes in a region over a period of time can be used to predict the likelihood of a catastrophic one.⁵

Viewed this way, there is a modest correlation from one period to the next.⁶ There are also a few major outliers in the chart: two are Pakistan International Airlines and Ethiopian Airlines, which have had a persistently high rate of incidents. A third outlier, Russia’s Aeroflot, had an extraordinarily high number of reported incidents in the 1990s — many of them attempted hijackings around the time of the breakup of the Soviet Union — but only an average number in recent years. There is still a positive correlation even if those three airlines are excluded, however, which rates as modestly statistically significant⁷ — some airlines are slightly safer to fly than others.

Our preliminary answer, then, is that an airline’s track record tells you something about its probability of future crashes — although not a lot, and only if looked at in the right way. In particular, you should look toward an airline’s rate of dangerous incidents of any kind rather than its number of fatalities or fatal accidents. These near-misses are more consistent from period to period — and could result in a deadly crash the next time around.

But there’s a better rule to follow. If you’re insistent on minimizing your crash risk, you should avoid airlines from developing countries.

Let’s combine our three measures of crash rates — incidents, fatal accidents and fatalities — into a single measure which I’ll call the airline’s safety score. I calculate it as follows:

Positive scores indicate a safe track record — Australia’s Qantas, for instance, which is famous for avoiding crashes — has a safety score of +0.71. By contrast, Pakistan International Airlines has a score of -1.49.

The chart also lists the per-capita gross domestic product for the airline’s home country as of 1999 (the middle of the 30-year period). The correlation between a country’s wealth and the crash rates of its airlines is quite strong.⁸ Over the past 30 years, the top 10 safety scores belong to two airlines from the United States (Southwest Airlines and United Airlines), two from the United Kingdom, and one each from Canada, Australia, Hong Kong, Singapore, Germany and the Netherlands. By contrast, the 10 worst scores are for airlines from Colombia, Egypt, Ethiopia, Indonesia, Kenya, Morocco, Pakistan, the Philippines, Russia and Taiwan. In fact, if you want to predict an airline’s future rate of crashes, you’re best off looking at its home country’s GDP and largely ignoring its track record.⁹

Perhaps this shouldn’t be surprising. Commercial airlines are subject to extremely stringent safety standards, and the same standards are applied to all airlines from the same country or region. Richer countries, in air travel and many other aspects of public planning, can afford to buy more safety in the form of higher prices and more expensive regulations.

So should you never fly an airline from a developing country again? No, that would be silly — commercial airline travel is an extraordinarily safe means of transit overall. What you should do is avoid airlines on blacklists, such as that periodically put out by the European Union. (None of the airlines on the list of 56 above is currently on the EU’s blacklist, although one, Pakistan International Airlines, has been in the recent past.) Otherwise — even on Malaysia Airlines — the risk of being involved in a crash is very low, and that risk doesn’t increase much after a recent disaster.

CORRECTION (July 23, 9:54 a.m.): The tables in a previous version of this post used an incorrect denominator in calculating incidents, fatal accidents and fatalities. They had been assuming 80 percent rather than 100 percent of seats were filled by passengers, in accordance with standard industry load factors. However, the definition of an available seat kilometer (ASK), the statistic used elsewhere in the article, is based on the number of seats available and not how many of them were filled. The numbers in the tables have been changed to reflect the proper definition of an ASK.

In addition, we double-checked the numbers for all 56 airlines and found a small number of accidents that had previously been missed, as well as a couple of typos. These have been corrected. These changes do not significantly affect the relative ordering of the airlines or the overall conclusion of the article.

UPDATE (July 23, 9:54 a.m.): A number of readers were confused about the numbers described in the tables. They list the number of incidents, fatal accidents and fatalities per one trillion available seat kilometers (ASKs) flown, and not the raw numbers. This is an important distinction: For instance, United Airlines flies about 24 times more miles than Royal Air Maroc. United has had more accidents overall, but it has had considerably fewer per ASK. However, we’ve inserted the following table for people who would prefer to see the unadjusted numbers. We’ve also posted the data used in this article on GitHub.

Footnotes

One could argue for a different definition of risk — for instance, based on the number of takeoffs and landings, since relatively few crashes occur in the cruise phase of flight. That data is hard to find for international carriers, however, whereas ASKs are more commonly reported in the industry. ^
I also exclude airlines that principally flew charter flights for all or part of the period. ^
Fatal accidents, by my definition, must result in the death of a member of the passenger or crew — ground fatalities are not included. ^
Air China is not included in the table since it was founded after 1985. It has a decent safety record. ^
The potential downside is that it’s harder to define a dangerous incident than a fatal accident, so there may be inconsistent reporting standards in the data set. ^
The correlation coefficient is .37 ^
At the 95 percent confidence level. ^
The correlation between the natural logarithm of per-capita GDP in 1999 and an airline’s safety score over 1985-2014 is .70. ^
For instance, if you conduct a regression on an airline’s safety score from 2000-2014 on the basis of its safety score from 1985-1999 and the natural logarithm of its GDP in 1999, the GDP variable is highly statistically significant while its past safety score provides no additional predictive power. ^

Rule of thumb: Don’t fly on the national airline of a country that allows cattle to wander freely on the roads.

I would have liked to see a correlation with type of aircraft.

On a separate note, I flew Cathay Pacific and EVA a few months ago.

The FAs were young and they doted on me. They seemed disappointed if I didn’t need anything. Unlike those found on AA, Delta and United. (Disclosure: I was in business class, including the US based carriers)

I would have liked to see a correlation with type of aircraft.

That, and a list of whether maintenance was done by the airline or farmed out.

I prefer not to fly on an Airbus anything.

Should Travelers Avoid Flying Airlines That Have Had Crashes in the Past?

They'd be better off avoiding airlines that have crashes in their future, but that statistic is a tough one to get your hands on (until time travel has been perfected, that is).

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.