Meta-analyzing the multiverse: A peek under the hood of selective reporting.
Anton Olsson-Collentine; Robbie C. M. van Aert; Marjan Bakker; Jelte M. Wicherts · 2023 · Psychological Methods
WASTE classifies this as Negative / Null Result Report · AI classification, approximate
The study found no significant effect — useful as a negative control or null benchmark for your own design.
Abstract (excerpt)
-hacking) from this "multiverse" of outcomes can inflate effect size estimates and false positive rates. We studied the effects of researcher degrees of freedom and selective reporting using empirical data from extensive multistudy…
Excerpt shown for reference under fair use — read the full paper at the publisher.
About to run something similar?
Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.
Related failures
Estimating the reproducibility of psychological science
Negative / Null Result ReportWillingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
Methods Dead-EndComparing multiple comparisons: practical guidance for choosing the best multiple comparisons test
Replication FailureInferential Statistics as Descriptive Statistics: There Is No Replication Crisis if We Don’t Expect Replication
Negative / Null Result ReportMOBILE BANKING ADOPTION: APPLICATION OF DIFFUSION OF INNOVATION THEORY
Negative / Null Result ReportEnjoyment and social influence: predicting mobile payment adoption
WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.
Metadata source: OpenAlex · DOI 10.1037/met0000559