Other scientists worry that something less innocuous explains the lack of reproducibility.
Part way through his project to reproduce promising studies, Begley met for breakfast at a cancer conference with the lead scientist of one of the problematic studies.
"We went through the paper line by line, figure by figure," said Begley. "I explained that we re-did their experiment 50 times and never got their result. He said they'd done it six times and got this result once, but put it in the paper because it made the best story. It's very disillusioning."
Such selective publication is just one reason the scientific literature is peppered with incorrect results.
For one thing, basic science studies are rarely "blinded" the way clinical trials are. That is, researchers know which cell line or mouse got a treatment or had cancer. That can be a problem when data are subject to interpretation, as a researcher who is intellectually invested in a theory is more likely to interpret ambiguous evidence in its favor.
The problem goes beyond cancer.
On Tuesday, a committee of the National Academy of Sciences heard testimony that the number of scientific papers that had to be retracted increased more than tenfold over the last decade; the number of journal articles published rose only 44 percent.
Ferric Fang of the University of Washington, speaking to the panel, said he blamed a hypercompetitive academic environment that fosters poor science and even fraud, as too many researchers compete for diminishing funding.
"The surest ticket to getting a grant or job is getting published in a high-profile journal," said Fang. "This is an unhealthy belief that can lead a scientist to engage in sensationalism and sometimes even dishonest behavior."
The academic reward system discourages efforts to ensure a finding was not a fluke. Nor is there an incentive to verify someone else's discovery. As recently as the late 1990s, most potential cancer-drug targets were backed by 100 to 200 publications. Now each may have fewer than half a dozen.
"If you can write it up and get it published, you're not even thinking of reproducibility," said Ken Kaitin, director of the Tufts Center for the Study of Drug Development. "You make an observation and move on. There is no incentive to find out it was wrong."
Unfortunately, between the given utilitarian ethics and the need to publish, too many scientists have forgotten that one of the hallmarks of science is reproducibility.
What we are witnessing, Ladies and Gentlemen, is the decline and perhaps fall of Western Medicine. The rot has set in fueled by the grant system.
...too many basic scientific discoveries, done in animals or cells growing in lab dishes and meant to show the way to a new drug, are wrong.
My wife works in a science lab doing this type of research. I am told nightly of the abuses of the scientific method.
The people doing the research are trying to do a job, get a raise, and get promoted. Many don’t care about the science.
Not just cancer research, I suspect.
All you need to know about cancer research, and why I discourage all from giving a cent to cancer research.
http://www.youtube.com/watch?v=VuESsEZ2kH0
You’ll never look at the cancer industry the same way again.
It would be, in my opinion, surprising if even 50% of published research was either correct or reproducible.
This is not to say we shouldn't be funding research in this country. It is to say, however, that things need to change, a lot. The global warming elite are a perfect example of how mafia’s form in science.
Sounds like the “global warming” scam isn’t the only area where science as been corrupted by grant-greedy “scientists”.
IMO, repetition is the only standard for credibility.
Worthy of a ping list.
Worthy of another ping list, or two. :-)
Having written a couple of books that involve controversial topics in environmental regulation, needless to say, I have had to apply a screening method to what I regard as solid v. questionable or even intentionally bogus science. The principal criterion has been: If you can take the findings and produce a profitable product therewith, it’s probably solid. As a result, I tend to consider industry data more reliable than university findings.