Posted on 11/28/2017 1:27:41 PM PST by nickcarraway
As debate rumbles on about how and how much poor statistics is to blame for poor reproducibility, Nature asked influential statisticians to recommend one change to improve science. The common theme? The problem is not our maths, but ourselves.
To use statistics well, researchers must study how scientists analyse and interpret data and then apply that information to prevent cognitive mistakes.
In the past couple of decades, many fields have shifted from data sets with a dozen measurements to data sets with millions. Methods that were developed for a world with sparse and hard-to-collect information have been jury-rigged to handle bigger, more-diverse and more-complex data sets. No wonder the literature is now full of papers that use outdated statistics, misapply statistical tests and misinterpret results. The application of P values to determine whether an analysis is interesting is just one of the most visible of many shortcomings.
Its not enough to blame a surfeit of data and a lack of training in analysis1. Its also impractical to say that statistical metrics such as P values should not be used to make decisions. Sometimes a decision (editorial or funding, say) must be made, and clear guidelines are useful.
The root problem is that we know very little about how people analyse and process information. An illustrative exception is graphs. Experiments show that people struggle to compare angles in pie charts yet breeze through comparative lengths and heights in bar charts2. The move from pies to bars has brought better understanding.
We need to appreciate that data analysis is not purely computational and algorithmic it is a human behaviour. In this case, the behaviour is made worse by training that was developed for a data-poor era. This framing will enable us to address practical problems. For instance, how
(Excerpt) Read more at nature.com ...
This book has been in continuous print since 1954.....................
86.3% of statistics are made up on the spur of the moment.
That’s my claim and I;m sticking with it!
“There are three kinds of lies: lies, damned lies, and statistics.”....Mark Twain............
Find your favorite fallacy. How about, hard statistical evidence followed by poorly supported assertions that have nothing to do with the evidence. That’s bullying, IMHO.
Yep - it’s all about how you present the data. I never see confidence intervals, p-values, etc in any news reporting. Mainly because the only thing the idiots really understand is gross percentages...which can be fudged by using the other values.
Actually, that figure should be 86.3245769856%, which raises another separate issue. :=)
Firat step, get a box.
To date this book is probably the best book ever written on stats. Always keep a copy handy to lend to my friends (especially libs).
(Ignorance is bliss!) Solution: More epidemiology on how people collect, manipulate, analyse, communicate and consume data.
As Shakespeare said, "For all the rest, they'll take suggestion as a cat laps milk. They'll tell the clock to any business that we say befits the hour."
You mean that four out of five dentists DIDN'T really recommend Dentyne?
-PJ
I have an original, printing from 1950’s.................
Reality is too complex to model with numbers.
A famous example from WW2 was American statistician realized the German industry was continuing to grow despite massive bombing raids. This caused the military to switch from bombing factories to bombing people which strengthened German’s resolve to fight on. The reality was that weapons being made in the new German industry were generally crap and what the bombing raids were doing was reducing the quality of German arms which in turn reduced German fighting effectiveness. But this couldn’t be modeled statistically so it was ignored.
The most effective part of the US bombing campaign came in the last 6-8 months of the war where we targeted Germany’s transportation grid instead of its factories or people. The results of attacks that couldn’t be modeled by statistics. These attacks caused the Germany industry to grind to a halt as rare materials and food we were no longer able to get from point A to point B. If we’d listened to the air force generals urging attacks on the transport grid instead of the bean counters the war would have been over in late 1944.
Moral of the story: Never trust a bean counter.
My youngest Daughter double Majored ... she Interned at Ford and at that time was a Theoretical Math Major, they told her she needed a salable Degree and recommended Statistics so she made that her Primary but she Loves Theoretical Math and just does Statistics to pay the way cause Dad told her “NO LOANS” and Dad is 3 outta 3 (3 kids w Degrees and 3 kids without Student Loans)
One of my favorite sayings:
“If you torture numbers they will confess to anything.”
*** “Never trust a bean counter” ***
Where to start ...
May start with GIGO (Garbage In Garbage Out)
Bean Counters don’t do Tactics so if Air Force Generals were taking Orders from the inept it was either Politicians, other Generals, poor Intel on the ground or most likely Politicians, Bankers and Royals.
The beauty of the US Forces in Europe WW2 was the lack of communications perceived or fabricated allowed those on the ground to do what they needed to do to get the job done with Great Leaders like Patton.
Stealing that!
So no more asterisks!
She sounds like a smart young lady who takes after her dad. But I am surprised that Theoretical Math won’t pay the bills.
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.