Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Big Science is broken
The Week ^ | April 18, 2016 | Pascal-Emmanuel Gobry

Posted on 04/18/2016 6:44:09 AM PDT by Fitzy_888

Science is broken.

That's the thesis of a must-read article in First Things magazine, in which William A. Wilson accumulates evidence that a lot of published research is false. But that's not even the worst part.

Advocates of the existing scientific research paradigm usually smugly declare that while some published conclusions are surely false, the scientific method has "self-correcting mechanisms" that ensure that, eventually, the truth will prevail. Unfortunately for all of us, Wilson makes a convincing argument that those self-correcting mechanisms are broken.

For starters, there's a "replication crisis" in science. This is particularly true in the field of experimental psychology, where far too many prestigious psychology studies simply can't be reliably replicated. But it's not just psychology. In 2011, the pharmaceutical company Bayer looked at 67 blockbuster drug discovery research findings published in prestigious journals, and found that three-fourths of them weren't right. Another study of cancer research found that only 11 percent of preclinical cancer research could be reproduced. Even in physics, supposedly the hardest and most reliable of all sciences, Wilson points out that "two of the most vaunted physics results of the past few years — the announced discovery of both cosmic inflation and gravitational waves at the BICEP2 experiment in Antarctica, and the supposed discovery of superluminal neutrinos at the Swiss-Italian border — have now been retracted, with far less fanfare than when they were first published."

What explains this? In some cases, human error. Much of the research world exploded in rage and mockery when it was found out that a highly popularized finding by the economists Ken Rogoff and Carmen Reinhardt linking higher public debt to lower growth was due to an Excel error. Steven Levitt, of Freakonomics fame, largely built his career on a paper arguing that abortion led to lower crime rates 20 years later because the aborted babies were disproportionately future criminals. Two economists went through the painstaking work of recoding Levitt's statistical analysis — and found a basic arithmetic error.

Then there is outright fraud. In a 2011 survey of 2,000 research psychologists, over half admitted to selectively reporting those experiments that gave the result they were after. The survey also concluded that around 10 percent of research psychologists have engaged in outright falsification of data, and more than half have engaged in "less brazen but still fraudulent behavior such as reporting that a result was statistically significant when it was not, or deciding between two different data analysis techniques after looking at the results of each and choosing the more favorable."

Then there's everything in between human error and outright fraud: rounding out numbers the way that looks better, checking a result less thoroughly when it comes out the way you like, and so forth.

Still, shouldn't the mechanism of independent checking and peer review mean the wheat, eventually, will be sorted from the chaff?

Well, maybe not. There's actually good reason to believe the exact opposite is happening.

The peer review process doesn't work. Most observers of science guffaw at the so-called "Sokal affair," where a physicist named Alan Sokal submitted a gibberish paper to an obscure social studies journal, which accepted it. Less famous is a similar hoodwinking of the very prestigious British Medical Journal, to which a paper with eight major errors was submitted. Not a single one of the 221 scientists who reviewed the paper caught all the errors in it, and only 30 percent of reviewers recommended that the paper be rejected. Amazingly, the reviewers who were warned that they were in a study and that the paper might have problems with it found no more flaws than the ones who were in the dark.

This is serious. In the preclinical cancer study mentioned above, the authors note that "some non-reproducible preclinical papers had spawned an entire field, with hundreds of secondary publications that expanded on elements of the original observation, but did not actually seek to confirm or falsify its fundamental basis."

This gets into the question of the sociology of science. It's a familiar bromide that "science advances one funeral at a time." The greatest scientific pioneers were mavericks and weirdos. Most valuable scientific work is done by youngsters. Older scientists are more likely to be invested, both emotionally and from a career and prestige perspective, in the regnant paradigm, even though the spirit of science is the challenge of regnant paradigms.

Why, then, is our scientific process so structured as to reward the old and the prestigious? Government funding bodies and peer review bodies are inevitably staffed by the most hallowed (read: out of touch) practitioners in the field. The tenure process ensures that in order to further their careers, the youngest scientists in a given department must kowtow to their elders' theories or run a significant professional risk. Peer review isn't any good at keeping flawed studies out of major papers, but it can be deadly efficient at silencing heretical views.

All of this suggests that the current system isn't just showing cracks, but is actually broken, and in need of major reform. There is very good reason to believe that much scientific research published today is false, there is no good way to sort the wheat from the chaff, and, most importantly, that the way the system is designed ensures that this will continue being the case.

As Wilson writes:

Even if self-correction does occur and theories move strictly along a lifecycle from less to more accurate, what if the unremitting flood of new, mostly false, results pours in faster? Too fast for the sclerotic, compromised truth-discerning mechanisms of science to operate? The result could be a growing body of true theories completely overwhelmed by an ever-larger thicket of baseless theories, such that the proportion of true scientific beliefs shrinks even while the absolute number of them continues to rise. Borges' Library of Babel contained every true book that could ever be written, but it was useless because it also contained every false book, and both true and false were lost within an ocean of nonsense. [First Things]

This is a big problem, one that can't be solved with a column. But the first step is admitting you have a problem.

Science, at heart an enterprise for mavericks, has become an enterprise for careerists. It's time to flip the career track for science on its head. Instead of waiting until someone's best years are behind her to award her academic freedom and prestige, abolish the PhD and grant fellowships to the best 22-year-olds, giving them the biggest budgets and the most freedoms for the first five or 10 years of their careers. Then, with only few exceptions, shift them away from research to teaching or some other harmless activity. Only then can we begin to fix Big Science.


TOPICS: Culture/Society; Miscellaneous; News/Current Events; Philosophy
KEYWORDS: academicbias; bigscience; climatechange; g41; globalwarming; science; sciencetrust; tenure
Navigation: use the links below to view more comments.
first previous 1-2021-4041-6061-70 next last
To: Roccus

Sometimes, the right thing is done for a the wrong reason. Kennedy only wanted to get to the moon as a political achievement. He wasn’t interested otherwise.

However, many, if not all, of us benefitted and still benefit by the push of math and science in the late 1950’s and into the 1960’s.


41 posted on 04/18/2016 7:52:59 AM PDT by kosciusko51
[ Post Reply | Private Reply | To 36 | View Replies]

To: goodwithagun

It’s quite possible that the effects of conventional treatments have been overstated and others, understated. Another problem is that there isn’t just one ailment called cancer any more than there is just one ailment called a fever. The medicine that cures one fever might not even touch another fever.

I wish you a victory over your illness by any morally acceptable means. If standing on your head and snorting cactus juice does the trick, then by all means do it.


42 posted on 04/18/2016 7:54:39 AM PDT by HiTech RedNeck (Embrace the Lion of Judah and He will roar for you and teach you to roar too. See my page.)
[ Post Reply | Private Reply | To 35 | View Replies]

To: originalbuckeye

Agreed. The problem with “science” is that people forget it is not just “climate change”, or looking for the “God particle”, or finding out about “dark matter”.

There are many areas of science that are still flourishing today. But the problem is that in other areas, careers are not in jeopardy for being wrong, but are in jeopardy due to losing funding sources for not coming up with the “correct” answer.


43 posted on 04/18/2016 7:57:54 AM PDT by kosciusko51
[ Post Reply | Private Reply | To 40 | View Replies]

To: Fitzy_888

No class of people is beyond lying, stabbing colleagues in the sck, punishing whistleblowers, lynching those who wont go along with their programs and agendas. Trying to destroy those that they regard as enemies.

All people are flawed and sinful. All prone to do things that are not above board. The type of scrutiny and built in checks and balances they have to live with combined with personal morals, and the consequences set up for those discovered to be lying/corrupt, is what helps people stay honest and do the right things.


44 posted on 04/18/2016 8:01:00 AM PDT by Secret Agent Man (Gone Galt; Not averse to Going Bronson.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Secret Agent Man

Well said.


45 posted on 04/18/2016 8:06:39 AM PDT by kosciusko51
[ Post Reply | Private Reply | To 44 | View Replies]

To: Roccus

Let me add that I’m not justifying the falsehoods.

However, there was a legitimate arms race going on at the time. Yes, it might have been overblown at the beginning, but as time went on, the USSR did surpass us in terms of numbers with their weaponry. Had the US decided not to act at that time, we would be looking at a much different 1980’s than we had.


46 posted on 04/18/2016 8:11:07 AM PDT by kosciusko51
[ Post Reply | Private Reply | To 36 | View Replies]

To: glasseye
I would add DDT, Freon 12, peak oil, and many more BS theories that have gone belly up. With Zika virus top of the news cycle, someone should just mention "Bring Back DDT" and watch who's heads explode. For 40-50 years of my life, children would follow the DDT spray trucks, dancing and running in the spray with no ill effects. "Silent Spring" has been totally debunked, but DDT is still banned. Freon 12 has been banned for almost 30 years now and the ozone hole is the same as it has always been. Only now, Freon 134a costs $8 a pound vs. .89 cents for Freon 12 when it was banned. As soon as 5 years ago, "science" was still touting peak oil was coming. How's that working out? Now we know there has been NO warming for at least 19 years.

This is designed to get grant money from the gubmint, so Jr. won't have to get a real job.

47 posted on 04/18/2016 8:17:07 AM PDT by chuckles
[ Post Reply | Private Reply | To 2 | View Replies]

To: Fitzy_888

Bookmark.


48 posted on 04/18/2016 8:17:15 AM PDT by aquila48
[ Post Reply | Private Reply | To 1 | View Replies]

To: Fitzy_888

The problem with Big Science is that the big research money is sponsored by entities that expect certain results...that favor their cause.


49 posted on 04/18/2016 8:29:51 AM PDT by pfflier
[ Post Reply | Private Reply | To 1 | View Replies]

To: Robert357

Ironically, that is the same speech where Eisenhower warned of the military-industrial complex. We hear that quote all the time yet his warning about science being controlled by government funding is only a paragraph or two later in the same speech.


50 posted on 04/18/2016 8:33:21 AM PDT by pfflier
[ Post Reply | Private Reply | To 13 | View Replies]

To: Fitzy_888
I was trained in science in the 60s and 70s, and the problem with the status quo is glaringly obvious - except that no one is being trained in science anymore, so no one can see it.

In a nutshell, a proper publication or other announcement of an experimental result is a challenge - "I dare you to prove me wrong, if you can".

Now, the challenge is, "If you DARE to try to prove me wrong, I will have your career ended".

No science can happen under that type of threat.

51 posted on 04/18/2016 8:38:02 AM PDT by Jim Noble (Ryan never could have outfought Trump. I never knew, until this day, that it was Romney all along.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: butlerweave

Sounds like another opportunity to apologize.

I would like to apologize for Obama someday. But the list of accusations, I mean apologies, is so long.


52 posted on 04/18/2016 8:41:47 AM PDT by ChessExpert (It is not compassion when you use government to give other people's money away.)
[ Post Reply | Private Reply | To 22 | View Replies]

To: HiTech RedNeck

I have an extremely rare case. It’s not been seen before. I quickly discovered that docs just wanted to treat me so that they could be associated with my case.


53 posted on 04/18/2016 8:44:40 AM PDT by goodwithagun (March 3, 2016: The date FReepers justified the "goodness" of Planned Parenthood.)
[ Post Reply | Private Reply | To 42 | View Replies]

To: originalbuckeye

I would love to know the doctor and the hospital. I bet I can guess the hospital. I worked at a prestigious cancer hospital in the 80s, and the guy I worked for faked his work, or at least plagiarized it. I left that job quickly and found other research work nearby. Feel free to pm me if that’s ok.


54 posted on 04/18/2016 8:52:33 AM PDT by FamiliarFace
[ Post Reply | Private Reply | To 16 | View Replies]

To: smartyaz

Government Academia complex?


55 posted on 04/18/2016 8:57:25 AM PDT by ChessExpert (It is not compassion when you use government to give other people's money away.)
[ Post Reply | Private Reply | To 8 | View Replies]

To: originalbuckeye
No one has been able to replicate the ‘gay gene’ ‘fact’ since then.

Because it isn't true. Identical twin studies prove homosexuality is not genetic

56 posted on 04/18/2016 9:01:16 AM PDT by ELS
[ Post Reply | Private Reply | To 21 | View Replies]

To: Fitzy_888

I see that I’m not the first person to think of global warming.

As I recall, no one was able to reproduce Michael Mann’s work. He wouldn’t divulge his methods lest deniers attack his work.


57 posted on 04/18/2016 9:05:27 AM PDT by ChessExpert (It is not compassion when you use government to give other people's money away.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: goodwithagun

Have you seen the video series “The Truth About Cancer”? It illustrates the absurdity of conventional cancer treatment.


58 posted on 04/18/2016 9:09:34 AM PDT by ELS
[ Post Reply | Private Reply | To 35 | View Replies]

To: Fitzy_888

97% of scientists think this article is bunk.


59 posted on 04/18/2016 9:16:33 AM PDT by pas
[ Post Reply | Private Reply | To 1 | View Replies]

To: Fitzy_888

False, but true?


60 posted on 04/18/2016 9:22:57 AM PDT by bruin66 (Time: Nature's way of keeping everything from happening at once.)
[ Post Reply | Private Reply | To 1 | View Replies]


Navigation: use the links below to view more comments.
first previous 1-2021-4041-6061-70 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson