Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Statisticians can prove almost anything, a new study finds
National Post ^ | November 20, 2011 | Joseph Brean

Posted on 11/22/2011 6:05:34 AM PST by reaganaut1

Catchy headlines about the latest counter-intuitive discovery in human psychology have a special place in journalism, offering a quirky distraction from the horrors of war and crime, the tedium of politics and the drudgery of economics.

But even as readers smirk over the latest gee whizzery about human nature, it is generally assumed that behind the headlines, in the peer-reviewed pages of academia, most scientists are engaged in sober analysis of rigorously gathered data, and that this leads them reliably to the truth.

Not so, says a new report in the journal Psychological Science, which claims to show “how unacceptably easy it is to accumulate (and report) statistically significant evidence for a false hypothesis.”

In “False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant,” two scientists from the Wharton School of Business at the University of Pennsylvania, and a colleague from Berkeley, argue that modern academic psychologists have so much flexibility with numbers that they can literally prove anything.

In effect turning the weapons of statistical analysis against their own side, the trio managed to to prove something demonstrably false, and thereby cast a wide shadow of doubt on any researcher who claims his findings are “statistically significant.”

In “many cases, a researcher is more likely to falsely find evidence that an effect exists than to correctly find evidence that it does not,” they write.

Defined as “the incorrect rejection of a null hypothesis,” a false positive is “perhaps the most costly error” a scientist can make, they write, in part because they are “particularly persistent” in the literature.”

False positives also waste resources, and “inspire investment in fruitless research programs and can lead to ineffective policy changes.” Finally, they argue, a field known for publishing false positives risks losing its credibility.

(Excerpt) Read more at news.nationalpost.com ...


TOPICS: Culture/Society
KEYWORDS: psychology; statistics
Navigation: use the links below to view more comments.
first 1-2021-4041-46 next last

1 posted on 11/22/2011 6:05:37 AM PST by reaganaut1
[ Post Reply | Private Reply | View Replies]

To: reaganaut1

2 posted on 11/22/2011 6:14:16 AM PST by paterfamilias
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

Like how is it statistically possible that the antithesis for social conservatism is “leading” in the polls? (Newt)


3 posted on 11/22/2011 6:14:31 AM PST by petercooper (2012 - Purge more RINO's.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

This is news? The Global Warming crowd have been running this con for years.


4 posted on 11/22/2011 6:15:47 AM PST by fhayek
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1
Not so, says a new report in the journal Psychological Science, which claims to show “how unacceptably easy it is to accumulate (and report) statistically significant evidence for a false hypothesis.”

This explains the current raving lunacy of Paul Krugman.

5 posted on 11/22/2011 6:16:00 AM PST by Paradox (The rich SHOULD be paying more taxes, and they WOULD, if they could make more money.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

This isn’t news.


6 posted on 11/22/2011 6:17:55 AM PST by FourPeas ("Maladjusted and wigging out is no way to go through life, son." -hg)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1
Two obvious points are illustrated by this article:
  1. Statistics require interpretation, not revealed truth.
  2. Psychology is not a science.

None of this should be news.

7 posted on 11/22/2011 6:18:25 AM PST by irv (Live Tea or die!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

When I first got out of college I worked with a man who was close to retirement age. When people would selectively manipulate data he would say “no matter how much you polish it a road apple is still a road apple.”


8 posted on 11/22/2011 6:18:44 AM PST by hometoroost (Frodo lives!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

I wonder what percentage of the time they can prove what they want to prove...


9 posted on 11/22/2011 6:20:07 AM PST by MrB (The difference between a Humanist and a Satanist - the latter knows whom he's working for)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

This explains why the global warming hoax was so effective in the beginning


10 posted on 11/22/2011 6:21:13 AM PST by PATRIOT1876 (The only crimes that are 100% preventable are crimes committed by illegal aliens)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

Well duh, 3 out of 4 people already knew this to be true.


11 posted on 11/22/2011 6:21:29 AM PST by servo1969
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1
"There are lies, damn lies and statistics."
attributed to Mark Twain
12 posted on 11/22/2011 6:22:17 AM PST by The Great RJ ("The problem with socialism is that pretty soon you run out of other people's money" M. Thatcher)
[ Post Reply | Private Reply | To 1 | View Replies]

To: reaganaut1

It took a statistician to figure this crap out?


13 posted on 11/22/2011 6:25:26 AM PST by Steamburg (The contents of your wallet is the only language Politicians understand.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: The Great RJ

OR
Numbers don’t lie but statisticians do.


14 posted on 11/22/2011 6:27:38 AM PST by bossmechanic (If all else fails, hit it with a hammer)
[ Post Reply | Private Reply | To 12 | View Replies]

To: hometoroost

You can’t polish a turd, but you can roll it in glitter!


15 posted on 11/22/2011 6:30:17 AM PST by cuban leaf (Were doomed! Details at eleven.)
[ Post Reply | Private Reply | To 8 | View Replies]

To: PATRIOT1876

“This explains why the global warming hoax was so effective in the beginning”

There were so many math errors in the global warming mumbo-jumbo that for a moment I thought that the analysis was being done by the senate finance committee.


16 posted on 11/22/2011 6:30:36 AM PST by Da Coyote (Liberalism - when you absolutely, positively have no ability to produce wealth.)
[ Post Reply | Private Reply | To 10 | View Replies]

To: servo1969

—Well duh, 3 out of 4 people already knew this to be true.—

I did hear, a number of years ago, that six out of four co-eds had been date raped.


17 posted on 11/22/2011 6:31:06 AM PST by cuban leaf (Were doomed! Details at eleven.)
[ Post Reply | Private Reply | To 11 | View Replies]

To: servo1969

And if you add up the numbers, I believe 120% of the country’s population is saved at revival meetings every year.


18 posted on 11/22/2011 6:32:00 AM PST by cuban leaf (Were doomed! Details at eleven.)
[ Post Reply | Private Reply | To 11 | View Replies]

To: servo1969

I read an article claiming that the unemployment rate at the OWS meetings was lower than at the TEA party meetings.

They didn’t mention that a lot of people at the TEA party meetings where retired, and the OWS folks were often just plain lying, or their “job” was washing dishes or flipping burgers.


19 posted on 11/22/2011 6:33:38 AM PST by cuban leaf (Were doomed! Details at eleven.)
[ Post Reply | Private Reply | To 11 | View Replies]

To: hometoroost

As I like to interpret our Dear Leader and his sycophants:
Figures don’t lie but liars figure.


20 posted on 11/22/2011 6:34:18 AM PST by TexasRedeye (Eschew obfuscation)
[ Post Reply | Private Reply | To 8 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-4041-46 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson