Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

Risk of being scooped drives scientists to shoddy methods
Science Magazine | Jan. 28, 2021 , 11:00 AM | By Cathleen O’Grady

Posted on 01/29/2021 8:05:17 AM PST by BenLurkin

Tiokhin’s team is not the first to make the argument that competition poses risks to science...But the model is the first to use details that explore precisely how those risks play out, he says.

...Tiokhin and his colleagues built a toy world of 120 scientist “bots” competing for rewards. Each scientist in the simulation toiled away, collecting data on a series of research questions. The bots were programmed with different strategies: Some were more likely than others to collect large, meaningful data sets. And some tended to abandon a research question if someone else published on it first, whereas others held on stubbornly. As the bots made discoveries and published, they accrued rewards—and those with the most rewards passed on their methods more often to the next generation of researchers.

... When they gave the bots bigger rewards for publishing first, the populations tended to rush their research and collect less data. That led to research filled with shaky results... When the difference in reward wasn’t so high, the scientists veered toward larger sample sizes and a slower publishing pace.

...

Rewarding scientists for publishing negative findings—an oft-discussed reform—lowered research quality, as the bots figured out that they could run studies with small sample sizes, find nothing of interest, and still get rewarded. Advocates of publishing negative findings often highlight the danger of publishing only positive results, which drives publication bias and hides the negative results that help build a full picture of reality. But Tiokhin says the modeling suggests rewarding researchers for publishing negative results, without focusing on research quality, will incentivize scientists to “run the crappiest studies that they can.”


TOPICS: Computers/Internet
KEYWORDS:

1 posted on 01/29/2021 8:05:17 AM PST by BenLurkin
[ Post Reply | Private Reply | View Replies]

To: BenLurkin

Actually it’s funding streams and political influence that causes scientists (at least in this country) to be corrupt. Implying it’s just sloppiness misses 90% of the problem.


2 posted on 01/29/2021 8:13:20 AM PST by BobL (TheDonald.win is now Patriots.win)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin
A study based on nothing but computer simulations.

It gives us nothing more than what people already knew.

3 posted on 01/29/2021 8:14:17 AM PST by marktwain (President Trump and his supporters are the Resistance. His opponents are the Reactionaries. )
[ Post Reply | Private Reply | To 1 | View Replies]

To: marktwain

Note, however, the credence given to the simulation. If only the statistical analysis which demonstrates that the 2020 election was stolen were as readily received.


4 posted on 01/29/2021 8:16:28 AM PST by BenLurkin (The above is not a statement of fact. It is either opinion, or satire. Or both.)
[ Post Reply | Private Reply | To 3 | View Replies]

To: BenLurkin
Yes.

Simply used as a propaganda tool.

5 posted on 01/29/2021 8:22:00 AM PST by marktwain (President Trump and his supporters are the Resistance. His opponents are the Reactionaries. )
[ Post Reply | Private Reply | To 4 | View Replies]

To: BenLurkin
And no one goes back to duplicate the work in published papers to see if they actually work, which is the primary reason to publish. If researchers start trying to reproduce the results and find they can't, then maybe some of this shoddy research wouldn't be published. Instead of checking it other researchers just site it in their own papers.
6 posted on 01/29/2021 8:24:45 AM PST by KarlInOhio (The greatest threat to world freedom is the Chinese Communist Party and Joe Biden is their puppet.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

Sadly, this publication has become one of the prime examples of “shoddy” during the past decade...


7 posted on 01/29/2021 8:28:35 AM PST by SuperLuminal (Where is Joe McCarthy now that we desperately need him sober?)
[ Post Reply | Private Reply | To 1 | View Replies]

To: KarlInOhio; All
About 70% of papers are not reproducible.

From the link:

The reproducibility difficulties are not about fraud, according to Dame Ottoline Leyser, director of the Sainsbury Laboratory at the University of Cambridge.

That would be relatively easy to stamp out. Instead, she says: "It's about a culture that promotes impact over substance, flashy findings over the dull, confirmatory work that most of science is about."

She says it's about the funding bodies that want to secure the biggest bang for their bucks, the peer review journals that vie to publish the most exciting breakthroughs, the institutes and universities that measure success in grants won and papers published and the ambition of the researchers themselves.

8 posted on 01/30/2021 7:32:24 AM PST by marktwain (President Trump and his supporters are the Resistance. His opponents are the Reactionaries. )
[ Post Reply | Private Reply | To 6 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson