A searchable index of real negative results, null findings, and replication failures from the published literature — so you can learn what didn't work before repeating it.
WASTE indexes published research — it does not host or republish full papers. Each entry is a metadata record (title, authors, DOI) compiled from open scholarly databases, with the abstract shown in full only where the paper is openly licensed (e.g. Creative Commons); otherwise a short excerpt is shown for reference under fair use. WASTE classifies each work by failure type; classifications are automated and approximate.
23 results in Replication Failure for "replication"
Alexander A. Aarts · 2015 · Science
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using…
Richard Klein, Kate A. Ratliff, Michelangelo Vianello et al. · 2014 · Social Psychology
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344…
Valentin Amrhein, David Trafimow, Sander Greenland · 2019 · The American Statistician
Statistical inference often fails to replicate. One reason is that many results may be selected for drawing inference because some threshold of a statistic like the P-value was crossed, leading to biased reported effect sizes. Nonetheless,…
Jay J. Van Bavel, Peter Mende‐Siedlecki, William J. Brady et al. · 2016 · Proceedings of the National Academy of Sciences
In recent years, scientists have paid increasing attention to reproducibility. For example, the Reproducibility Project, a large-scale replication attempt of 100 studies published in top psychology journals found that only 39% could be…
Joseph Cesario · 2014 · Perspectives on Psychological Science
Concerns have been raised recently about the replicability of behavioral priming effects, and calls have been issued to identify priming methodologies with effects that can be obtained in any context and with any population. I argue that…
Dermot Lynott, Katherine S. Corker, Jessica Wortman et al. · 2014 · Social Psychology
We report the results of three high-powered, independent replications of Study 2 from Williams and Bargh (2008) . Participants evaluated hot or cold instant therapeutic packs before choosing a reward for participation that was framed as a…
Eric‐Jan Wagenmakers, Josine Verhagen, Alexander Ly · 2015 · Behavior Research Methods
We present a suite of Bayes factor hypothesis tests that allow researchers to grade the decisiveness of the evidence that the data provide for the presence versus the absence of a correlation between two variables. For concreteness, we apply our methods to the recent work of Donnellan et al. (in press) who conducted nine replication studies with over 3,000 participants and failed to replicate the phenomenon that lonely people compensate for a lack of social warmth by taking warmer baths or showers. We show how the Bayes factor hypothesis test can quantify evidence in favor of the null hypothes
Cameron D. Palmer, Itsik Pe’er · 2017 · PLoS Genetics
Genome-wide association studies (GWAS) have identified hundreds of SNPs responsible for variation in human quantitative traits. However, genome-wide-significant associations often fail to replicate across independent cohorts, in apparent inconsistency with their apparent strong effects in discovery cohorts. This limited success of replication raises pervasive questions about the utility of the GWAS field. We identify all 332 studies of quantitative traits from the NHGRI-EBI GWAS Database with attempted replication. We find that the majority of studies provide insufficient data to evaluate repl
Rianne Haartsen, Emily J. H. Jones, Elena V. Orekhova et al. · 2019 · Translational Psychiatry
We conducted a replication study of our prior report that increased alpha EEG connectivity at 14-months associates with later autism spectrum disorder (ASD) diagnosis, and dimensional variation in restricted interests/repetitive behaviours. 143 infants at high and low familial risk for ASD watched dynamic videos of spinning toys and women singing nursery rhymes while high-density EEG was recorded. Alpha functional connectivity (7-8 Hz) was calculated using the debiased weighted phase lag index. The final sample with clean data included low-risk infants (N = 20), and high-risk infants who at 36
Yang Yang, Wu Youyou, Brian Uzzi · 2020 · Proceedings of the National Academy of Sciences
Replicability tests of scientific papers show that the majority of papers fail replication. Moreover, failed papers circulate through the literature as quickly as replicating papers. This dynamic weakens the literature, raises research…
Tobias Schuwerk, Beate Priewasser, Beate Sodian et al. · 2018 · Royal Society Open Science
Influential studies showed that 25-month-olds and neurotypical adults take an agent's false belief into account in their anticipatory looking patterns (Southgate et al. 2007 Psychol. Sci. 18 , 587–592 ( doi:10.1111/j.1467-9280.2007.01944.x ); Senju et al. 2009 Science 325 , 883–885 ( doi:10.1126/science.1176170 )). These findings constitute central pillars of current accounts distinguishing between implicit and explicit Theory of Mind. In our first experiment, which initially included a replication as well as two manipulations, we failed to replicate the original finding in 2- to 3-year-olds (
Hamid Seyedsayamdost · 2014 · Philosophical Psychology
In their paper titled “Gender and philosophical intuition,” Buckwalter and Stich argue that the intuitions of women and men differ significantly on various types of philosophical questions. Furthermore, men's intuitions, so the authors…
Stephan Lewandowsky, Klaus Oberauer · 2020 · Nature Communications
There is a broad agreement that psychology is facing a replication crisis. Even some seemingly well-established findings have failed to replicate. Numerous causes of the crisis have been identified, such as underpowered studies, publication bias, imprecise theories, and inadequate statistical procedures. The replication crisis is real, but it is less clear how it should be resolved. Here we examine potential solutions by modeling a scientific community under various different replication regimes. In one regime, all findings are replicated before publication to guard against subsequent replicat
Kristen P. Lindgren, Reínout W. Wiers, Bethany A. Teachman et al. · 2015 · PLoS ONE
There is preliminary evidence that approach avoid training can shift implicit alcohol associations and improve treatment outcomes. We sought to replicate and extend those findings in US undergraduate social drinkers (Study 1) and at-risk drinkers (Study 2). Three adaptations of the approach avoid task (AAT) were tested. The first adaptation - the approach avoid training - was a replication and targeted implicit alcohol approach associations. The remaining two adaptations - the general identity and personalized identity trainings - targeted implicit drinking identity associations, which are rob
Domenica Veniero, Christopher Benwell, Merle M. Ahrens et al. · 2017 · Frontiers in Psychology
Transcranial electrical stimulation (tES) is being investigated as an experimental and clinical interventional technique in human participants. While promising, important limitations have been identified, including weak effect sizes and high inter- and intra-individual variability of outcomes. Here, we compared two "inhibitory" tES-techniques with supposedly different mechanisms of action as to their effects on performance in a visuospatial attention task, and report on a direct replication attempt. In two experiments, 2 × 20 healthy participants underwent tES in three separate sessions testin
Dóra Kampis, Petra Karman, Gergely Csibra et al. · 2021 · Royal Society Open Science
, 587-592. (doi:10.1111/j.1467-9280.2007.01944.x)) has been widely cited as evidence for false-belief attribution in young children. Recent replication attempts of this paradigm have yielded mixed results: several studies did not replicate the original findings, raising doubts about the suitability of the paradigm to assess non-verbal action prediction and Theory of Mind. In a preregistered collaborative study including two of the original authors, we tested one hundred and sixty 24- to 26-month-olds across two locations using the original stimuli, procedure and analyses as closely as possible
Tal Linzen, Yohei Oseki · 2018 · Glossa a journal of general linguistics
The reliability of acceptability judgments made by individual linguists has often been called into question. Recent large-scale replication studies conducted in response to this criticism have shown that the majority of published English acceptability judgments are robust. We make two observations about these replication studies. First, we raise the concern that English acceptability judgments may be more reliable than judgments in other languages. Second, we argue that it is unnecessary to replicate judgments that illustrate uncontroversial descriptive facts; rather, candidates for replicatio
Arnold Kochari, Monique Flecken · 2018 · Language Cognition and Neuroscience
An important question in predictive language processing is the extent to which prediction effects can reliably be measured on pre-nominal material (e.g. articles before nouns). Here, we present a large sample (N = 58) close replication of a study by Otten and van Berkum (2009). They report ERP modulations in relation to the predictability of nouns in sentences, measured on gender-marked Dutch articles. We used nearly identical materials, procedures, and data analysis steps. We fail to replicate the original effect, but do observe a pattern consistent with the original data. Methodological diff
John P. Crowley, Ryan Allred, Julianna Follon et al. · 2018 · Communication Studies
Research on the mere presence hypothesis shows mixed findings for the effects of cell phone presence on various conversation outcomes. The current study performed a partial replication of Przybylski and Weinstein’s (2013) study, which…
Beth Lloyd, Franz Wurm, Roy de Kleijn et al. · 2023 · Brain stimulation
BackgroundTranscutaneous auricular vagus nerve stimulation (taVNS) has been tested as a potential treatment for pharmaco-resistant epilepsy and depression. Its clinical efficacy is thought to depend on taVNS-induced activation of the locus coeruleus and other neuromodulator systems. However, unlike for invasive VNS in rodents, there is little evidence for an effect of taVNS on noradrenergic activity.ObjectiveWe attempted to replicate recently published findings by Sharon et al. (2021), showing that short bursts of taVNS transiently increased pupil size and decreased EEG alpha power, two correl
Rolf Ulrich, Jeff Miller · 2020 · eLife
This article examines why many studies fail to replicate statistically significant published results. We address this issue within a general statistical framework that also allows us to include various questionable research practices (QRPs) that are thought to reduce replicability. The analyses indicate that the base rate of true effects is the major factor that determines the replication rate of scientific results. Specifically, for purely statistical reasons, replicability is low in research domains where true effects are rare (e.g., search for effective drugs in pharmacology). This point is
Kevin van Schie, Arne Leer · 2019 · Clinical Psychological Science
In this direct replication of Houben, Otgaar, Roelofs, and Merckelbach ( Clinical Psychological Science, 6, 610–616, 2018), we tested whether making eye movements during memory recall increases susceptibility to creating false memories.…
Bjørn Sætrevik, Hallgeir Sjåstad · 2022 · Meta-Psychology
Mortality salience (MS) effects, where death reminders lead to ingroup-bias and defensive protection of one’s world-view, have been claimed to be a fundamental human motivator. MS phenomena have ostensibly been identified in several hundred studies within the “terror management theory” framework, but transparent and high-powered replications are lacking. Experiment 1 (N = 101 Norwegian lab participants) aimed to replicate the traditional MSeffect on national patriotism, with additional novel measures of democratic values and pro-sociality. Experiment2 (N = 784 US online participants) aimed to