Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

Over half of psychology studies fail reproducibility test
Nature ^ | Monya Baker

Posted on 08/27/2015 11:41:03 AM PDT by BenLurkin

Don’t trust everything you read in the psychology literature. In fact, two thirds of it should probably be distrusted.

In the biggest project of its kind, Brian Nosek, a social psychologist and head of the Center for Open Science in Charlottesville, Virginia, and 269 co-authors repeated work reported in 98 original papers from three psychology journals, to see if they independently came up with the same results.

The studies they took on ranged from whether expressing insecurities perpetuates them to differences in how children and adults respond to fear stimuli, to effective ways to teach arithmetic.

According to the replicators' qualitative assessments, as previously reported by Nature, only 39 of the 100 replication attempts were successful. (There were 100 completed replication attempts on the 98 papers, as in two cases replication efforts were duplicated by separate teams.)

...

The work is part of the Reproducibility Project, launched in 2011 amid high-profile reports of fraud and faulty statistical analysis that led to an identity crisis in psychology.

John Ioannidis, an epidemiologist at Stanford University in California, says that the true replication-failure rate could exceed 80%, even higher than Nosek's study suggests. This is because the Reproducibility Project targeted work in highly respected journals, the original scientists worked closely with the replicators, and replicating teams generally opted for papers employing relatively easy methods — all things that should have made replication easier.

(Excerpt) Read more at nature.com ...


TOPICS: Science
KEYWORDS:
Navigation: use the links below to view more comments.
first 1-2021-25 next last

1 posted on 08/27/2015 11:41:03 AM PDT by BenLurkin
[ Post Reply | Private Reply | View Replies]

To: BenLurkin

What’s the rule, that under the most tightly controlled conditions the subject does what it jolly well wishes?


2 posted on 08/27/2015 11:42:54 AM PDT by HiTech RedNeck (Embrace the Lion of Judah and He will roar for you and teach you to roar too. See my page.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

What about Global Warming theory?


3 posted on 08/27/2015 11:44:03 AM PDT by Uncle Miltie (RINOs EARNED TRUMP! I prefer Cruz, but someone has to kick their A$$!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

So does human caused global warming, so does string theory. Much junk science out there these days.


4 posted on 08/27/2015 11:44:26 AM PDT by DesertRhino (I was standing with a rifle, waiting for soviet paratroopers, but comSUrfmunists just ran for office)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

It’s all subjective.


5 posted on 08/27/2015 11:44:58 AM PDT by bgill ( CDC site, "we still do not know exactly how people are infected with Ebola")
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

In fact, arguments exist as to whether or not psychology is even a science at all.


6 posted on 08/27/2015 11:45:16 AM PDT by DesertRhino (I was standing with a rifle, waiting for soviet paratroopers, but comSUrfmunists just ran for office)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

If only 39% of studies were reproducible, that essentially means that ALL psychological studies should be mistrusted.


7 posted on 08/27/2015 11:47:25 AM PDT by Redbob (Keep your hands off my great-great-grandfather's flag)
[ Post Reply | Private Reply | To 1 | View Replies]

To: DesertRhino; BenLurkin
In fact, arguments exist as to whether or not psychology is even a science at all.

Psychology is all in your mind.

8 posted on 08/27/2015 11:47:31 AM PDT by MeganC (The Republic of The United States of America: 7/4/1776 to 6/26/2015 R.I.P.)
[ Post Reply | Private Reply | To 6 | View Replies]

To: DesertRhino
"In fact, arguments exist as to whether or not psychology is even a science at all."

If you can't replicate results I say if definitely is not. How many psychological "studies" are based on survey data? That's about as reliable as a Magic 8 Ball.

9 posted on 08/27/2015 11:50:59 AM PDT by circlecity
[ Post Reply | Private Reply | To 6 | View Replies]

To: DesertRhino
Not that long ago the Psych world was gaga over lobotomy, autism was Freudian based (mother withholding love from the child. Congrats, your kid had autism and you have guilt), and shock was all the rage.

Psychologist are like Emily Litella, “Never mind”.

10 posted on 08/27/2015 11:53:48 AM PDT by fungoking (Tis a pleasure to live in the Ozarks)
[ Post Reply | Private Reply | To 6 | View Replies]

To: DesertRhino
Everything I learned about psychology I learned from The Sopranos or the idiots who freaked out thinking the Psych 101 textbooks talked about them.
11 posted on 08/27/2015 11:55:33 AM PDT by Read Write Repeat
[ Post Reply | Private Reply | To 6 | View Replies]

To: BenLurkin

Well into the realm of ‘soft sciences’, as in marshmallow soft, air-puff soft.

Would love to dig a statistic - are most psychologists liberal Democrats? Remember that is how Charles Krauthammer started in the Carter campaign!


12 posted on 08/27/2015 12:00:08 PM PDT by SES1066 (Quality, Speed or Economical - Any 2 of 3 except in government - 1 at best but never #3!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: circlecity

If you can’t replicate results I say if definitely is not. How many psychological “studies” are based on survey data? That’s about as reliable as a Magic 8 Ball.


You can add education studies to that list.


13 posted on 08/27/2015 12:02:51 PM PDT by PeterPrinciple (Thinking Caps are no longer being issued but there must be a warehouse full of them somewhere.)
[ Post Reply | Private Reply | To 9 | View Replies]

To: BenLurkin

http://www.newyorker.com/magazine/2010/12/13/the-truth-wears-off

... The problem of selective reporting is rooted in a fundamental cognitive flaw, which is that we like proving ourselves right and hate being wrong. “It feels good to validate a hypothesis,” Ioannidis said. “It feels even better when you’ve got a financial interest in the idea or your career depends upon it. And that’s why, even after a claim has been systematically disproven”—he cites, for instance, the early work on hormone replacement therapy, or claims involving various vitamins—“you still see some stubborn researchers citing the first few studies that show a strong effect. They really want to believe that it’s true.”


14 posted on 08/27/2015 12:03:01 PM PDT by HangnJudge (Cthulhu for President, why vote for a lesser Evil)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

A survey of social science professionals found that 1 in 100 to 1 in 300 was a conservative, versus 40% of the average population.
They often start studies with a radical bias and cherry pick data to fit the agenda, readily suppress studies that contradict their version of reality, regularly promote interpretations that don’t reflect the minor trends or correlations of the study and ignore the left wing bias of results generated by samples of their own studies.
And then there is their overwhelming view of conservatives as either immoral, stupid or evil - and the studies that have that as a built in assumption.


15 posted on 08/27/2015 12:33:22 PM PDT by tbw2
[ Post Reply | Private Reply | To 1 | View Replies]

To: HangnJudge
Linus Pauling would be appalled.
16 posted on 08/27/2015 12:34:26 PM PDT by BlueDragon (need any say more)
[ Post Reply | Private Reply | To 14 | View Replies]

To: BenLurkin

Just think what that does to megastudies!


17 posted on 08/27/2015 12:40:02 PM PDT by huldah1776
[ Post Reply | Private Reply | To 1 | View Replies]

To: SES1066

In school, I got know a large number of pysch students (my roommate was trying to become a psychologist).

All of them had several personal issues that they were hoping to resolve. I don’t me just plain odd, I mean bat crap crazy issues.

In that school, at that time, all of my roommates classmates that he brought home went into pysch to fix themselves.

As an engineer, that troubles me.


18 posted on 08/27/2015 12:43:27 PM PDT by redgolum ("God is dead" -- Nietzsche. "Nietzsche is dead" -- God.)
[ Post Reply | Private Reply | To 12 | View Replies]

To: BenLurkin

“Neutrinos pass through anything, no matter how dense.”


19 posted on 08/27/2015 12:47:46 PM PDT by pabianice (LINE)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

Psychology - pseudo science.


20 posted on 08/27/2015 12:49:00 PM PDT by DungeonMaster (Of those born of women there is not risen one greater than John The Baptist.)
[ Post Reply | Private Reply | To 1 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-25 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson