A searchable index of real negative results, null findings, and replication failures from the published literature — so you can learn what didn't work before repeating it.
WASTE indexes published research — it does not host or republish full papers. Each entry is a metadata record (title, authors, DOI) compiled from open scholarly databases, with the abstract shown in full only where the paper is openly licensed (e.g. Creative Commons); otherwise a short excerpt is shown for reference under fair use. WASTE classifies each work by failure type; classifications are automated and approximate.
278 results for "replication" · page 1 of 10
Alexander A. Aarts · 2015 · Science
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using…
Frank Dudbridge · 2013 · PLoS Genetics
Polygenic scores have recently been used to summarise genetic effects among an ensemble of markers that do not individually achieve significance in a large-scale association study. Markers are selected using an initial training sample and used to construct a score in an independent replication sample by forming the weighted sum of associated alleles within each subject. Association between a trait and this composite score implies that a genetic signal is present among the selected markers, and the score can then be used for prediction of individual trait values. This approach has been used to
Richard Klein, Kate A. Ratliff, Michelangelo Vianello et al. · 2014 · Social Psychology
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344…
Richard Klein, Michelangelo Vianello, Fred Hasselman et al. · 2018 · Advances in Methods and Practices in Psychological Science
We conducted preregistered replications of 28 classic and contemporary published findings, with protocols that were peer reviewed in advance, to examine variation in effect magnitudes across samples and settings. Each protocol was…
Tyler W. Watts, Greg J. Duncan, Haonan Quan · 2018 · Psychological Science
We replicated and extended Shoda, Mischel, and Peake's (1990) famous marshmallow study, which showed strong bivariate correlations between a child's ability to delay gratification just before entering school and both adolescent achievement…
Christopher J. Soto · 2019 · Psychological Science
The Big Five personality traits have been linked to dozens of life outcomes. However, metascientific research has raised questions about the replicability of behavioral science. The Life Outcomes of Personality Replication (LOOPR) Project…
Valentin Amrhein, David Trafimow, Sander Greenland · 2019 · The American Statistician
Statistical inference often fails to replicate. One reason is that many results may be selected for drawing inference because some threshold of a statistic like the P-value was crossed, leading to biased reported effect sizes. Nonetheless,…
Jay J. Van Bavel, Peter Mende‐Siedlecki, William J. Brady et al. · 2016 · Proceedings of the National Academy of Sciences
In recent years, scientists have paid increasing attention to reproducibility. For example, the Reproducibility Project, a large-scale replication attempt of 100 studies published in top psychology journals found that only 39% could be…
Joseph Cesario · 2014 · Perspectives on Psychological Science
Concerns have been raised recently about the replicability of behavioral priming effects, and calls have been issued to identify priming methodologies with effects that can be obtained in any context and with any population. I argue that…
Mante S. Nieuwland, Stephen Politzer‐Ahles, Evelien Heyselaar et al. · 2018 · eLife
Do people routinely pre-activate the meaning and even the phonological form of upcoming words? The most acclaimed evidence for phonological prediction comes from a 2005 Nature Neuroscience publication by DeLong, Urbach and Kutas, who observed a graded modulation of electrical brain potentials (N400) to nouns and preceding articles by the probability that people use a word to continue the sentence fragment (‘cloze’). In our direct replication study spanning 9 laboratories (N=334), pre-registered replication-analyses and exploratory Bayes factor analyses successfully replicated the noun-results
Federico Innocenti, Gregory M. Cooper, Ian B. Stanaway et al. · 2011 · PLoS Genetics
The discovery of expression quantitative trait loci ("eQTLs") can help to unravel genetic contributions to complex traits. We identified genetic determinants of human liver gene expression variation using two independent collections of primary tissue profiled with Agilent (n = 206) and Illumina (n = 60) expression arrays and Illumina SNP genotyping (550K), and we also incorporated data from a published study (n = 266). We found that ∼30% of SNP-expression correlations in one study failed to replicate in either of the others, even at thresholds yielding high reproducibility in simulations, and
David Zendle, Paul Cairns · 2019 · PLoS ONE
Loot boxes are items in video games that contain randomised contents and can be purchased with real-world money. Similarities between loot boxes and forms of gambling have led to questions about their legal status, and whether they should be regulated as gambling. Previous research has suggested a link between the amount that gamers spend on loot boxes and their problem gambling: The more individuals spent on loot boxes, the more severe their problem gambling. However, the generalisability of prior work may be limited by both the self-selected nature of the sample under test, and the fact that
Christine R. Harris, Noriko Coburn, Doug Rohrer et al. · 2013 · PLoS ONE
Bargh et al. (2001) reported two experiments in which people were exposed to words related to achievement (e.g., strive, attain) or to neutral words, and then performed a demanding cognitive task. Performance on the task was enhanced after exposure to the achievement related words. Bargh and colleagues concluded that better performance was due to the achievement words having activated a "high-performance goal". Because the paper has been cited well over 1100 times, an attempt to replicate its findings would seem warranted. Two direct replication attempts were performed. Results from the first
Dermot Lynott, Katherine S. Corker, Jessica Wortman et al. · 2014 · Social Psychology
We report the results of three high-powered, independent replications of Study 2 from Williams and Bargh (2008) . Participants evaluated hot or cold instant therapeutic packs before choosing a reward for participation that was framed as a…
Alexander M. Aiken, Calum Davey, James Hargreaves et al. · 2015 · International Journal of Epidemiology
BACKGROUND: Helminth (worm) infections cause morbidity among poor communities worldwide. An influential study conducted in Kenya in 1998-99 reported that a school-based drug-and-educational intervention had benefits regarding worm…
Eric‐Jan Wagenmakers, Josine Verhagen, Alexander Ly · 2015 · Behavior Research Methods
We present a suite of Bayes factor hypothesis tests that allow researchers to grade the decisiveness of the evidence that the data provide for the presence versus the absence of a correlation between two variables. For concreteness, we apply our methods to the recent work of Donnellan et al. (in press) who conducted nine replication studies with over 3,000 participants and failed to replicate the phenomenon that lonely people compensate for a lack of social warmth by taking warmer baths or showers. We show how the Bayes factor hypothesis test can quantify evidence in favor of the null hypothes
Cameron D. Palmer, Itsik Pe’er · 2017 · PLoS Genetics
Genome-wide association studies (GWAS) have identified hundreds of SNPs responsible for variation in human quantitative traits. However, genome-wide-significant associations often fail to replicate across independent cohorts, in apparent inconsistency with their apparent strong effects in discovery cohorts. This limited success of replication raises pervasive questions about the utility of the GWAS field. We identify all 332 studies of quantitative traits from the NHGRI-EBI GWAS Database with attempted replication. We find that the majority of studies provide insufficient data to evaluate repl
Tobias Wingen, Jana Berkessel, Birte Englich · 2019 · Social Psychological and Personality Science
In the current psychological debate, low replicability of psychological findings is a central topic. While the discussion about the replication crisis has a huge impact on psychological research, we know less about how it impacts public trust in psychology. In this article, we examine whether low replicability damages public trust and how this damage can be repaired. Studies 1–3 provide correlational and experimental evidence that low replicability reduces public trust in psychology. Additionally, Studies 3–5 evaluate the effectiveness of commonly used trust-repair strategies such as informati
Min-Sun Kim, Yuan Yuan · 2015 · Episteme
Abstract In “Normativity and Epistemic Intuitions” (NEI), Weinberg, Nichols and Stich famously argue from empirical data that East Asians and Westerners have different intuitions about Gettier-style cases. We attempted to replicate their…
Rianne Haartsen, Emily J. H. Jones, Elena V. Orekhova et al. · 2019 · Translational Psychiatry
We conducted a replication study of our prior report that increased alpha EEG connectivity at 14-months associates with later autism spectrum disorder (ASD) diagnosis, and dimensional variation in restricted interests/repetitive behaviours. 143 infants at high and low familial risk for ASD watched dynamic videos of spinning toys and women singing nursery rhymes while high-density EEG was recorded. Alpha functional connectivity (7-8 Hz) was calculated using the debiased weighted phase lag index. The final sample with clean data included low-risk infants (N = 20), and high-risk infants who at 36
Charles R. Ebersole, Maya B. Mathur, Erica Baranski et al. · 2020 · Advances in Methods and Practices in Psychological Science
Replication studies in psychological science sometimes fail to reproduce prior findings. If these studies use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to…
Yang Yang, Wu Youyou, Brian Uzzi · 2020 · Proceedings of the National Academy of Sciences
Replicability tests of scientific papers show that the majority of papers fail replication. Moreover, failed papers circulate through the literature as quickly as replicating papers. This dynamic weakens the literature, raises research…
Christian Garm, María Moreno‐Villanueva, Alexander Bürkle et al. · 2012 · Aging Cell
Exogenous and endogenous damage to DNA is constantly challenging the stability of our genome. This DNA damage increase the frequency of errors in DNA replication, thus causing point mutations or chromosomal rearrangements and has been…
Tobias Schuwerk, Beate Priewasser, Beate Sodian et al. · 2018 · Royal Society Open Science
Influential studies showed that 25-month-olds and neurotypical adults take an agent's false belief into account in their anticipatory looking patterns (Southgate et al. 2007 Psychol. Sci. 18 , 587–592 ( doi:10.1111/j.1467-9280.2007.01944.x ); Senju et al. 2009 Science 325 , 883–885 ( doi:10.1126/science.1176170 )). These findings constitute central pillars of current accounts distinguishing between implicit and explicit Theory of Mind. In our first experiment, which initially included a replication as well as two manipulations, we failed to replicate the original finding in 2- to 3-year-olds (
R. Anand, Kartik Shah, Hengyao Niu et al. · 2011 · Nucleic Acids Research
DNA sequences that form secondary structures or bind protein complexes are known barriers to replication and potential inducers of genome instability. In order to determine which helicases facilitate DNA replication across these barriers,…
Hamid Seyedsayamdost · 2014 · Philosophical Psychology
In their paper titled “Gender and philosophical intuition,” Buckwalter and Stich argue that the intuitions of women and men differ significantly on various types of philosophical questions. Furthermore, men's intuitions, so the authors…
Anne J. M. R. Geijsen, Stefanie Brezina, Pekka Keski‐Rahkonen et al. · 2019 · International Journal of Cancer
Colorectal cancer is known to arise from multiple tumorigenic pathways; however, the underlying mechanisms remain not completely understood. Metabolomics is becoming an increasingly popular tool in assessing biological processes. Previous metabolomics research focusing on colorectal cancer is limited by sample size and did not replicate findings in independent study populations to verify robustness of reported findings. Here, we performed a ultrahigh performance liquid chromatography-quadrupole time-of-flight mass spectrometry (UHPLC-QTOF-MS) screening on EDTA plasma from 268 colorectal cancer
Stephan Lewandowsky, Klaus Oberauer · 2020 · Nature Communications
There is a broad agreement that psychology is facing a replication crisis. Even some seemingly well-established findings have failed to replicate. Numerous causes of the crisis have been identified, such as underpowered studies, publication bias, imprecise theories, and inadequate statistical procedures. The replication crisis is real, but it is less clear how it should be resolved. Here we examine potential solutions by modeling a scientific community under various different replication regimes. In one regime, all findings are replicated before publication to guard against subsequent replicat
Andrés Cárdenas, Sabrina Faleschini, Andrea P. Cortés Hidalgo et al. · 2019 · Clinical Epigenetics
BACKGROUND: Maternal mood disorders and their treatment during pregnancy may have effects on the offspring epigenome. We aim to evaluate associations of maternal prenatal antidepressant use, anxiety, and depression with cord blood DNA methylation across the genome at birth and test for persistence of associations in early and mid-childhood blood DNA. METHODS: A discovery phase was conducted in Project Viva, a prospective pre-birth cohort study with external replication in an independent cohort, the Generation R Study. In Project Viva, pregnant women were recruited between 1999 and 2002 in East
Ignácio F. Mata, Dora Yearout, Victoria Álvarez et al. · 2011 · Movement Disorders
Recent genome-wide association studies of Parkinson's disease have nominated 3 new susceptibility loci (PARK16-18) and confirmed 2 known risk genes (MAPT and SNCA) in populations of European ancestry. We sought to replicate these findings.…