How to quantify the evidence for the absence of a correlation
Eric‐Jan Wagenmakers; Josine Verhagen; Alexander Ly · 2015 · Behavior Research Methods
WASTE classifies this as Replication Failure · AI classification, approximate
A previously reported effect did not replicate here — verify it holds before you build on it.
Abstract
We present a suite of Bayes factor hypothesis tests that allow researchers to grade the decisiveness of the evidence that the data provide for the presence versus the absence of a correlation between two variables. For concreteness, we apply our methods to the recent work of Donnellan et al. (in press) who conducted nine replication studies with over 3,000 participants and failed to replicate the phenomenon that lonely people compensate for a lack of social warmth by taking warmer baths or showers. We show how the Bayes factor hypothesis test can quantify evidence in favor of the null hypothes
Abstract by Eric‐Jan Wagenmakers; Josine Verhagen; Alexander Ly, Behavior Research Methods (2015) — licensed CC BY 4.0.
About to run something similar?
Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.
Related failures
Our Princess Is in Another Castle
Negative / Null Result ReportUsing Psychological Artificial Intelligence (Tess) to Relieve Symptoms of Depression and Anxiety: Randomized Controlled Trial
Negative / Null Result ReportHow Replicable Are Links Between Personality Traits and Consequential Life Outcomes? The Life Outcomes of Personality Replication Project
Negative / Null Result ReportThe cross-cultural validity of posttraumatic stress disorder: implications for DSM-5
Negative / Null Result ReportPsychiatric and medical correlates of DSM‐5 eating disorders in a nationally representative sample of adults in the United States
Negative / Null Result ReportRomantic relationships and the physical and mental health of college students
WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.
Metadata source: OpenAlex · DOI 10.3758/s13428-015-0593-0
