Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Global Warming Bombshell
Technology Review ^ | 10/15/04 | Richard Muller

Posted on 10/17/2004 10:15:43 PM PDT by Pikamax

Global Warming Bombshell A prime piece of evidence linking human activity to climate change turns out to be an artifact of poor mathematics.

By Richard Muller Technology for Presidents October 15, 2004

Progress in science is sometimes made by great discoveries. But science also advances when we learn that something we believed to be true isn’t. When solving a jigsaw puzzle, the solution can sometimes be stymied by the fact that a wrong piece has been wedged in a key place.

In the scientific and political debate over global warming, the latest wrong piece may be the “hockey stick,” the famous plot (shown below), published by University of Massachusetts geoscientist Michael Mann and colleagues. This plot purports to show that we are now experiencing the warmest climate in a millennium, and that the earth, after remaining cool for centuries during the medieval era, suddenly began to heat up about 100 years ago--just at the time that the burning of coal and oil led to an increase in atmospheric levels of carbon dioxide.

I talked about this at length in my December 2003 column. Unfortunately, discussion of this plot has been so polluted by political and activist frenzy that it is hard to dig into it to reach the science. My earlier column was largely a plea to let science proceed unmolested. Unfortunately, the very importance of the issue has made careful science difficult to pursue.

But now a shock: Canadian scientists Stephen McIntyre and Ross McKitrick have uncovered a fundamental mathematical flaw in the computer program that was used to produce the hockey stick. In his original publications of the stick, Mann purported to use a standard method known as principal component analysis, or PCA, to find the dominant features in a set of more than 70 different climate records.

But it wasn’t so. McIntyre and McKitrick obtained part of the program that Mann used, and they found serious problems. Not only does the program not do conventional PCA, but it handles data normalization in a way that can only be described as mistaken.

Now comes the real shocker. This improper normalization procedure tends to emphasize any data that do have the hockey stick shape, and to suppress all data that do not. To demonstrate this effect, McIntyre and McKitrick created some meaningless test data that had, on average, no trends. This method of generating random data is called “Monte Carlo” analysis, after the famous casino, and it is widely used in statistical analysis to test procedures. When McIntyre and McKitrick fed these random data into the Mann procedure, out popped a hockey stick shape!

That discovery hit me like a bombshell, and I suspect it is having the same effect on many others. Suddenly the hockey stick, the poster-child of the global warming community, turns out to be an artifact of poor mathematics. How could it happen? What is going on? Let me digress into a short technical discussion of how this incredible error took place.

In PCA and similar techniques, each of the (in this case, typically 70) different data sets have their averages subtracted (so they have a mean of zero), and then are multiplied by a number to make their average variation around that mean to be equal to one; in technical jargon, we say that each data set is normalized to zero mean and unit variance. In standard PCA, each data set is normalized over its complete data period; for key climate data sets that Mann used to create his hockey stick graph, this was the interval 1400-1980. But the computer program Mann used did not do that. Instead, it forced each data set to have zero mean for the time period 1902-1980, and to match the historical records for this interval. This is the time when the historical temperature is well known, so this procedure does guarantee the most accurate temperature scale. But it completely screws up PCA. PCA is mostly concerned with the data sets that have high variance, and the Mann normalization procedure tends to give very high variance to any data set with a hockey stick shape. (Such data sets have zero mean only over the 1902-1980 period, not over the longer 1400-1980 period.)

The net result: the “principal component” will have a hockey stick shape even if most of the data do not.

McIntyre and McKitrick sent their detailed analysis to Nature magazine for publication, and it was extensively refereed. But their paper was finally rejected. In frustration, McIntyre and McKitrick put the entire record of their submission and the referee reports on a Web page for all to see. If you look, you’ll see that McIntyre and McKitrick have found numerous other problems with the Mann analysis. I emphasize the bug in their PCA program simply because it is so blatant and so easy to understand. Apparently, Mann and his colleagues never tested their program with the standard Monte Carlo approach, or they would have discovered the error themselves. Other and different criticisms of the hockey stick are emerging (see, for example, the paper by Hans von Storch and colleagues in the September 30 issue of Science).

Some people may complain that McIntyre and McKitrick did not publish their results in a refereed journal. That is true--but not for lack of trying. Moreover, the paper was refereed--and even better, the referee reports are there for us to read. McIntyre and McKitrick’s only failure was in not convincing Nature that the paper was important enough to publish.

How does this bombshell affect what we think about global warming?

It certainly does not negate the threat of a long-term global temperature increase. In fact, McIntyre and McKitrick are careful to point out that it is hard to draw conclusions from these data, even with their corrections. Did medieval global warming take place? Last month the consensus was that it did not; now the correct answer is that nobody really knows. Uncovering errors in the Mann analysis doesn’t settle the debate; it just reopens it. We now know less about the history of climate, and its natural fluctuations over century-scale time frames, than we thought we knew.

If you are concerned about global warming (as I am) and think that human-created carbon dioxide may contribute (as I do), then you still should agree that we are much better off having broken the hockey stick. Misinformation can do real harm, because it distorts predictions. Suppose, for example, that future measurements in the years 2005-2015 show a clear and distinct global cooling trend. (It could happen.) If we mistakenly took the hockey stick seriously--that is, if we believed that natural fluctuations in climate are small--then we might conclude (mistakenly) that the cooling could not be just a random fluctuation on top of a long-term warming trend, since according to the hockey stick, such fluctuations are negligible. And that might lead in turn to the mistaken conclusion that global warming predictions are a lot of hooey. If, on the other hand, we reject the hockey stick, and recognize that natural fluctuations can be large, then we will not be misled by a few years of random cooling.

A phony hockey stick is more dangerous than a broken one--if we know it is broken. It is our responsibility as scientists to look at the data in an unbiased way, and draw whatever conclusions follow. When we discover a mistake, we admit it, learn from it, and perhaps discover once again the value of caution.

Richard A. Muller, a 1982 MacArthur Fellow, is a physics professor at the University of California, Berkeley, where he teaches a course called “Physics for Future Presidents.” Since 1972, he has been a Jason consultant on U.S. national security.


TOPICS: Culture/Society; Foreign Affairs; News/Current Events
KEYWORDS: climatechange; environment; hockeystick
Navigation: use the links below to view more comments.
first 1-2021-40 next last

1 posted on 10/17/2004 10:15:44 PM PDT by Pikamax
[ Post Reply | Private Reply | View Replies]

To: Pikamax
McIntyre and McKitrick’s only failure was in not convincing Nature that the paper was important enough to publish.

this bombshell

Nature and none of the referee's saw the importance of "this bombshell"?

2 posted on 10/17/2004 10:23:08 PM PDT by liberallarry
[ Post Reply | Private Reply | To 1 | View Replies]

To: Allan

Ping.


3 posted on 10/17/2004 10:23:23 PM PDT by Mitchell
[ Post Reply | Private Reply | To 1 | View Replies]

To: Pikamax

Well, shouldn't it be easy enough to take their data and plot it to a correctly calibrated graph?

Oh, and as for medieval global warming, they used to be able to grow grapes in large quantites in England, and the Vikings lived in Greenland...


4 posted on 10/17/2004 10:23:26 PM PDT by swilhelm73 (Democrats and free speech are like oil and water)
[ Post Reply | Private Reply | To 1 | View Replies]

To: swilhelm73
Oh, and as for medieval global warming, they used to be able to grow grapes in large quantites in England, and the Vikings lived in Greenland...

That was before the lack of industrialization led to Global Cooling... ;-)

5 posted on 10/17/2004 10:25:20 PM PDT by coconutt2000 (NO MORE PEACE FOR OIL!!! DOWN WITH TYRANTS, TERRORISTS, AND TIMIDCRATS!!!! (3-T's For World Peace))
[ Post Reply | Private Reply | To 4 | View Replies]

To: liberallarry
If I were a bad reporter like a liberal I would have the headline say: evidence linking human activity to climate change turns out to be an artifact of poor mathematics
6 posted on 10/17/2004 10:27:53 PM PDT by GeronL (John Kerry believes in a right to privacy and in gay rights............ ask "fair game" Mary Cheney)
[ Post Reply | Private Reply | To 2 | View Replies]

To: Pikamax
The web page mentioned in the article:

http://www.uoguelph.ca/~rmckitri/research/fallupdate04/update.fall04.html

7 posted on 10/17/2004 10:32:43 PM PDT by FreedomCalls (It's the "Statue of Liberty," not the "Statue of Security.")
[ Post Reply | Private Reply | To 1 | View Replies]

To: swilhelm73
Well, shouldn't it be easy enough to take their data and plot it to a correctly calibrated graph?

They did:

While it shows the upturned "hockey stick" from during the 20th Century, it shows that it is not unique and a similar climate was in effect in the 15th Century.

8 posted on 10/17/2004 10:39:37 PM PDT by FreedomCalls (It's the "Statue of Liberty," not the "Statue of Security.")
[ Post Reply | Private Reply | To 4 | View Replies]

To: Pikamax

Move along here...Nothing to see.


9 posted on 10/17/2004 10:40:56 PM PDT by stocksthatgoup (Polls = Proof that when the MSM want you attention they will give it to you.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: FreedomCalls

I expected that the graph would look something like that, the historical record suggests so.

Still, this is devastating to global warming theory.

BTW, this article implies it a bit, but isn't there a pretty good chance that Mann didn't make a mistake - he altered his data purposely to fit what he thought the expected behaviour to be?


10 posted on 10/17/2004 10:48:39 PM PDT by swilhelm73 (Democrats and free speech are like oil and water)
[ Post Reply | Private Reply | To 8 | View Replies]

To: Pikamax
global warming in medieval times?

they should read the Viking Sagas -
Eric the Red settled in Greenland 1,000 year ago because it was warm enough to be hospitable, indeed, he loved it there - lived there for decades, had a community there. His son, Leif, (Ericsson) lived there too, even tho' he had sailed down and explored Nova Scotia, Cape Cod, up the Hudson, etc. But after about 30 years of living in Greenland, the weather started turning too cold - and eventually, the community was abandoned. Then again, by the eraly 1600's, the winters in New Englnad were warmer than they are now...if one reads the letters and writings of the time. (Not that they were easy to deal with, what with hastily built homes and no stoves, no cars with heaters, etc.) But why mess with something that doesn't promote a pre-set agenda, huh?
11 posted on 10/17/2004 11:06:57 PM PDT by maine-iac7 (Dessert pot lucks on V-day)
[ Post Reply | Private Reply | To 1 | View Replies]

To: swilhelm73
this article implies it a bit, but isn't there a pretty good chance that Mann didn't make a mistake - he altered his data purposely to fit what he thought the expected behaviour to be?
****

wouldn't be the first scientist to do so.
Einstein admitted to the same when he found data not going where he was sure it should,
He alter admitted it and was very penitent
12 posted on 10/17/2004 11:10:15 PM PDT by maine-iac7 (Dessert pot lucks on V-day)
[ Post Reply | Private Reply | To 10 | View Replies]

To: Pikamax
A big bump for a wonderful article find.

The 'corrected' data results that have been previously published still haven't made it through the central filter of science, but that such a correction had to be made, in addition to rather well reasoned disputing of those results (and underlying data, method, and even motives) leads me to believe that this cause will continue to be taken up by more and more folks.
13 posted on 10/17/2004 11:31:17 PM PDT by kingu (Which would you bet on? Iraq and Afghanistan? Or Haiti and Kosovo?)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Pikamax

And so it is reported for the trillionth time that the "Egyptian Variable" hypothesis is true ~ that is, that you can come up with a number which when multiplied against the answer will give you the answer you wish.


14 posted on 10/17/2004 11:34:41 PM PDT by muawiyah
[ Post Reply | Private Reply | To 1 | View Replies]

To: Pikamax
Read this rather quickly - but did not even see the word 'ozone'. . .a few years ago; this would not be possible. (Yes, the ozone hole is closing. . .so it is no longer part of the 'dialogue')and now this!

As indicated, this does not preclude 'global changes'; warming. . .just our presence impacting these changes. Greenies will not be happy! What will Ralph Nader say? Algore???

I can only say. . .'what goes around...comes around'; sooner; or later.

15 posted on 10/17/2004 11:37:31 PM PDT by cricket (Don't lose your head. . vote Republican. . .)
[ Post Reply | Private Reply | To 1 | View Replies]

To: FreedomCalls

My wife has a 2 year math/science degree. Her Earth Science professor insisted that the earth's climate is self-regulating; skew the mean temperature a few degrees in either direction, and it kicks off an ice age and the whole system resets. (And before you panic, humans survive quite nicely during ice ages- just maybe not in such huge numbers.)


16 posted on 10/18/2004 12:05:15 AM PDT by Ostlandr (Nationalist, small-r republican, fiscal conservative, social liberal, pagan. NOT a Bush partisan!)
[ Post Reply | Private Reply | To 8 | View Replies]

To: GeronL

Or "Scientist Uses Math To Continue Bush's Assault On The Environment".


17 posted on 10/18/2004 12:18:07 AM PDT by SoDak
[ Post Reply | Private Reply | To 6 | View Replies]

To: FreedomCalls

How the heck are they getting average temps from the 1600's?


18 posted on 10/18/2004 12:20:57 AM PDT by SoDak
[ Post Reply | Private Reply | To 8 | View Replies]

To: Pikamax

We are coming out of an ice age. We are SUPPOSED to be warming up, for crying out loud!


19 posted on 10/18/2004 12:26:38 AM PDT by broadsword (Weren't there a couple of giant Buddhist statues in Afghanistan? What happened to them?)
[ Post Reply | Private Reply | To 1 | View Replies]

To: SoDak

lol


20 posted on 10/18/2004 12:26:56 AM PDT by GeronL (John Kerry believes in a right to privacy and in gay rights............ ask "fair game" Mary Cheney)
[ Post Reply | Private Reply | To 17 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-40 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson