163
submitted 1 year ago by dirtmayor@beehaw.org to c/news@beehaw.org

Archive Link from archive.today

Original link from The New York Times

you are viewing a single comment's thread
view the rest of the comments
[-] Jo@readit.buzz 7 points 1 year ago* (last edited 1 year ago)

The high rate of failure to replicate is not, in and of itself, evidence of fraud. It's primarily a problem with low power to detect plausible effects (ie small sample sizes). That's not to say there isn't much deliberate fraud or p-hacking going on, there's far too much. But the so-called replication crisis was entirely predictable without needing to assume any wrongdoing. It happened primarily because most researchers don't fully understand the statistics they are using.

There was a good paper published on this recently: Understanding the Replication Crisis as a Base Rate Fallacy

And this is a nice simple explanation of the base rate fallacy for anyone who can't access the paper: The p value and the base rate fallacy

tl;dr p<0.05 does not mean what most researchers think it means

[-] Chetzemoka@kbin.social 4 points 1 year ago

The Harvard scholar is being accused of deliberately fabricating study results by changing data in a spreadsheet on at least one of the studies.

I think the other commenter mentioned lack of replicability because that's often one of the first indications that the original research results were fraudulent. Inability to reproduce will cause people to go digging through the original data, which is how this stuff gets found in many cases.

this post was submitted on 24 Jun 2023
163 points (100.0% liked)

World News

22057 readers
31 users here now

Breaking news from around the world.

News that is American but has an international facet may also be posted here.


Guidelines for submissions:

These guidelines will be enforced on a know-it-when-I-see-it basis.


For US News, see the US News community.


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS