Inferential Statistics as Descriptive Statistics: There Is No Replication Crisis if We Don’t Expect Replication
Valentin Amrhein; David Trafimow; Sander Greenland · 2019 · The American Statistician
WASTE classifies this as Replication Failure · AI classification, approximate
A previously reported effect did not replicate here — verify it holds before you build on it.
Abstract (excerpt)
Statistical inference often fails to replicate. One reason is that many results may be selected for drawing inference because some threshold of a statistic like the P-value was crossed, leading to biased reported effect sizes. Nonetheless,…
Excerpt shown for reference under fair use — read the full paper at the publisher.
About to run something similar?
Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.
Related failures
Estimating the reproducibility of psychological science
Negative / Null Result ReportWillingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
Methods Dead-EndComparing multiple comparisons: practical guidance for choosing the best multiple comparisons test
Negative / Null Result ReportMOBILE BANKING ADOPTION: APPLICATION OF DIFFUSION OF INNOVATION THEORY
Negative / Null Result ReportEnjoyment and social influence: predicting mobile payment adoption
Negative / Null Result ReportLikelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time
WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.
Metadata source: OpenAlex · DOI 10.1080/00031305.2018.1543137