Replication FailureOpen accessPsychology
Eric‐Jan Wagenmakers, Josine Verhagen, Alexander Ly · 2015 · Behavior Research Methods
We present a suite of Bayes factor hypothesis tests that allow researchers to grade the decisiveness of the evidence that the data provide for the presence versus the absence of a correlation between two variables. For concreteness, we apply our methods to the recent work of Donnellan et al. (in press) who conducted nine replication studies with over 3,000 participants and failed to replicate the phenomenon that lonely people compensate for a lack of social warmth by taking warmer baths or showers. We show how the Bayes factor hypothesis test can quantify evidence in favor of the null hypothes
View details →DOI: 10.3758/s13428-015-0593-0Cited by 137 Replication FailureOpen accessDecision Sciences
Pepijn Obels, Daniël Lakens, Nicholas A. Coles et al. · 2020 · Advances in Methods and Practices in Psychological Science
Ongoing technological developments have made it easier than ever before for scientists to share their data, materials, and analysis code. Sharing data and analysis code makes it easier for other researchers to reuse or check published research. However, these benefits will emerge only if researchers can reproduce the analyses reported in published articles and if data are annotated well enough so that it is clear what all variable and value labels mean. Because most researchers are not trained in computational reproducibility, it is important to evaluate current practices to identify those tha
View details →DOI: 10.1177/2515245920918872Cited by 137 Replication FailurePsychology
Enda M. Byrne, Philip Gehrman, Sarah E. Medland et al. · 2013 · American Journal of Medical Genetics Part B Neuropsychiatric Genetics
Several aspects of sleep behavior such as timing, duration and quality have been demonstrated to be heritable. To identify common variants that influence sleep traits in the population, we conducted a genome-wide association study of six…
View details →DOI: 10.1002/ajmg.b.32168Cited by 132 Replication FailureMedicine
Li‐Tzong Chen, Miin-Fu Chen, Lung-An Li et al. · 2011 · Annals of Surgery
OBJECTIVE: To investigate the clinical efficacy of adjuvant interferon alfa-2b (IFNα-2b) therapy on recurrence-free survival (RFS) of patients with postoperative viral hepatitis-related hepatocellular carcinoma (HCC). BACKGROUND: Despite…
View details →DOI: 10.1097/sla.0b013e3182363ff9Cited by 129 Replication FailureOpen accessBiochemistry, Genetics and Molecular Biology
Cameron D. Palmer, Itsik Pe’er · 2017 · PLoS Genetics
Genome-wide association studies (GWAS) have identified hundreds of SNPs responsible for variation in human quantitative traits. However, genome-wide-significant associations often fail to replicate across independent cohorts, in apparent inconsistency with their apparent strong effects in discovery cohorts. This limited success of replication raises pervasive questions about the utility of the GWAS field. We identify all 332 studies of quantitative traits from the NHGRI-EBI GWAS Database with attempted replication. We find that the majority of studies provide insufficient data to evaluate repl
View details →DOI: 10.1371/journal.pgen.1006916Cited by 127 Replication FailureOpen accessNeuroscience
Dóra Matzke, Sander Nieuwenhuis, Hedderik van Rijn et al. · 2015 · Journal of Experimental Psychology General
A growing body of research has suggested that horizontal saccadic eye movements facilitate the retrieval of episodic memories in free recall and recognition memory tasks. Nevertheless, a minority of studies have failed to replicate this…
View details →DOI: 10.1037/xge0000038Cited by 118 Replication FailureDecision Sciences
James R. Lewis, Jeff Sauro · 2017 · Journal of Usability Studies archive
In 2009, we published a paper in which we showed how three independent sources of data indicated that, rather than being a unidimensional measure of perceived usability, the System Usability Scale apparently had two factors: Usability (all…
View details →DOI: 10.5555/3190867.3190870Cited by 115 Replication FailureEarth and Planetary Sciences
Shunsuke Tei, Atsuko Sugimoto, Hitoshi Yonenobu et al. · 2017 · Global Change Biology
Circumboreal forest ecosystems are exposed to a larger magnitude of warming in comparison with the global average, as a result of warming-induced environmental changes. However, it is not clear how tree growth in these ecosystems responds…
View details →DOI: 10.1111/gcb.13780Cited by 111 Replication FailureOpen accessNeuroscience
Nicolaas Prins · 2012 · Journal of Vision
In their influential paper, Wichmann and Hill (2001) have shown that the threshold and slope estimates of a psychometric function may be severely biased when it is assumed that the lapse rate equals zero but lapses do, in fact, occur.…
View details →DOI: 10.1167/12.6.25Cited by 108 Replication FailureOpen accessNeuroscience
Helena Cousijn, Saskia Haegens, George Wallis et al. · 2014 · Proceedings of the National Academy of Sciences
Gamma band oscillations arise in neuronal networks of interconnected GABAergic interneurons and excitatory pyramidal cells. A previous study found a correlation between visual gamma peak frequency, as measured with magnetoencephalography,…
View details →DOI: 10.1073/pnas.1321072111Cited by 106 Replication FailureOpen accessBiochemistry, Genetics and Molecular Biology
Karlijn Meeks, Peter Henneman, Andrea Venema et al. · 2017 · Clinical Epigenetics
Epigenome-wide association studies (EWAS) have identified DNA methylation loci involved in adiposity. However, EWAS on adiposity in sub-Saharan Africans are lacking despite the high burden of adiposity among African populations. We undertook an EWAS for anthropometric indices of adiposity among Ghanaians aiming to identify DNA methylation loci that are significantly associated. The Illumina 450k DNA methylation array was used to profile DNA methylation in whole blood samples of 547 Ghanaians from the Research on Obesity and Diabetes among African Migrants (RODAM) study. Differentially methylat
View details →DOI: 10.1186/s13148-017-0403-xCited by 105 Replication FailureOpen accessNeuroscience
Rianne Haartsen, Emily J. H. Jones, Elena V. Orekhova et al. · 2019 · Translational Psychiatry
We conducted a replication study of our prior report that increased alpha EEG connectivity at 14-months associates with later autism spectrum disorder (ASD) diagnosis, and dimensional variation in restricted interests/repetitive behaviours. 143 infants at high and low familial risk for ASD watched dynamic videos of spinning toys and women singing nursery rhymes while high-density EEG was recorded. Alpha functional connectivity (7-8 Hz) was calculated using the debiased weighted phase lag index. The final sample with clean data included low-risk infants (N = 20), and high-risk infants who at 36
View details →DOI: 10.1038/s41398-019-0380-2Cited by 105 Replication FailureOpen accessMedicine
Manaf AlQahtani, Abdulkarim Abdulrahman, Abdulrahman Almadani et al. · 2021 · Scientific Reports
Convalescent plasma (CP) therapy in COVID-19 disease may improve clinical outcome in severe disease. This pilot study was undertaken to inform feasibility and safety of further definitive studies. This was a prospective, interventional and randomized open label pilot trial in patients with severe COVID-19. Twenty COVID-19 patients received two 200 ml transfusions of convalescent patient CP over 24-h compared with 20 who received standard of care. The primary outcome was the requirement for ventilation (non-invasive or mechanical ventilation). The secondary outcomes were biochemical parameters
View details →DOI: 10.1038/s41598-021-89444-5Cited by 104 Replication FailureOpen accessComputer Science
Yang Yang, Wu Youyou, Brian Uzzi · 2020 · Proceedings of the National Academy of Sciences
Replicability tests of scientific papers show that the majority of papers fail replication. Moreover, failed papers circulate through the literature as quickly as replicating papers. This dynamic weakens the literature, raises research…
View details →DOI: 10.1073/pnas.1909046117Cited by 101 Replication FailureEngineering
Gregor D. Wehinger, Matthias Kraume, Viktor Berg et al. · 2016 · AIChE Journal
Dry reforming of methane (DRM) over nickel in a fixed‐bed reactor of spheres was studied experimentally and with CFD simulations. Temperature and mole fraction profiles were measured in a dedicated profile reactor as function of axial…
View details →DOI: 10.1002/aic.15520Cited by 100 Replication FailureSocial Sciences
Thomas S. Dee · 2014 · Journal of Research on Educational Effectiveness
One provocative explanation for the continued persistence of minority achievement gaps involves the performance-dampening anxiety thought to be experienced by minority students in highly evaluative settings (i.e., “stereotype threat”).…
View details →DOI: 10.1080/19345747.2014.906009Cited by 98 Replication FailureMedicine
Sebastian Wolfrum, Kevin Roedl, Alexia Hanebutte et al. · 2022 · Circulation
Background: This study was conducted to determine the effect of hypothermic temperature control after in-hospital cardiac arrest (IHCA) on mortality and functional outcome as compared with normothermia. Methods: An investigator initiated,…
View details →DOI: 10.1161/circulationaha.122.060106Cited by 93 Replication FailureOpen accessNeuroscience
Brooke N. Macnamara, Megha Maitra · 2019 · Royal Society Open Science
We sought to replicate Ericsson, Krampe & Tesch-Römer's (Ericsson, Krampe & Tesch-Römer 1993 Psychol. Rev. 100 , 363–406) seminal study on deliberate practice. Ericsson et al . found that differences in retrospective estimates of accumulated amounts of deliberate practice corresponded to each skill level of student violinists. They concluded, ‘individual differences in ultimate performance can largely be accounted for by differential amounts of past and current levels of practice’ (p. 392). We reproduced the methodology with notable exceptions, namely (i) employing a double-blind proce
View details →DOI: 10.1098/rsos.190327Cited by 93 Replication FailureOpen accessPsychology
Tobias Schuwerk, Beate Priewasser, Beate Sodian et al. · 2018 · Royal Society Open Science
Influential studies showed that 25-month-olds and neurotypical adults take an agent's false belief into account in their anticipatory looking patterns (Southgate et al. 2007 Psychol. Sci. 18 , 587–592 ( doi:10.1111/j.1467-9280.2007.01944.x ); Senju et al. 2009 Science 325 , 883–885 ( doi:10.1126/science.1176170 )). These findings constitute central pillars of current accounts distinguishing between implicit and explicit Theory of Mind. In our first experiment, which initially included a replication as well as two manipulations, we failed to replicate the original finding in 2- to 3-year-olds (
View details →DOI: 10.1098/rsos.172273Cited by 92 Replication FailureOpen accessMedicine
Mikkael A. Sekeres, J. E. Lancet, Brent L. Wood et al. · 2012 · Haematologica
Improving outcomes in older adults with acute myeloid leukemia remains a formidable challenge. Lintuzumab (SGN-33; HuM195) is a humanized monoclonal antibody directed against CD33, which is expressed on the majority of myeloblasts in acute…
View details →DOI: 10.3324/haematol.2012.066613Cited by 91 Replication FailureOpen accessPhysics and Astronomy
R. Abbott, H. Abe, F. Acernese et al. · 2025 · Physical review. D/Physical review. D.
The ever-increasing number of detections of gravitational waves from compact binaries by the Advanced LIGO and Advanced Virgo detectors allows us to perform ever-more sensitive tests of general relativity (GR) in the dynamical and…
View details →DOI: 10.1103/physrevd.112.084080Cited by 90 Replication FailureOpen accessNeuroscience
Hamid Seyedsayamdost · 2014 · Philosophical Psychology
In their paper titled “Gender and philosophical intuition,” Buckwalter and Stich argue that the intuitions of women and men differ significantly on various types of philosophical questions. Furthermore, men's intuitions, so the authors…
View details →DOI: 10.1080/09515089.2014.893288Cited by 87 Replication FailureOpen accessDecision Sciences
Stephan Lewandowsky, Klaus Oberauer · 2020 · Nature Communications
There is a broad agreement that psychology is facing a replication crisis. Even some seemingly well-established findings have failed to replicate. Numerous causes of the crisis have been identified, such as underpowered studies, publication bias, imprecise theories, and inadequate statistical procedures. The replication crisis is real, but it is less clear how it should be resolved. Here we examine potential solutions by modeling a scientific community under various different replication regimes. In one regime, all findings are replicated before publication to guard against subsequent replicat
View details →DOI: 10.1038/s41467-019-14203-0Cited by 80 Replication FailurePsychology
Susan Kashubeck‐West, Angela D. Coker, Germine H. Awad et al. · 2013 · Cultural Diversity & Ethnic Minority Psychology
This study examines reliability and validity estimates for 3 widely used measures in body image research in a sample of African American college women (N = 278). Internal consistency estimates were adequate (α coefficients above .70) for…
View details →DOI: 10.1037/a0031905Cited by 76 Replication FailureOpen accessBiochemistry, Genetics and Molecular Biology
Delilah Zabaneh, Eva Krapohl, Héléna A. Gaspar et al. · 2017 · Molecular Psychiatry
We used a case-control genome-wide association (GWA) design with cases consisting of 1238 individuals from the top 0.0003 (~170 mean IQ) of the population distribution of intelligence and 8172 unselected population-based controls. The…
View details →DOI: 10.1038/mp.2017.121Cited by 75 Replication FailureOpen accessNeuroscience
Varun Kilaru, Shruti V. Iyer, Lynn M. Almli et al. · 2016 · Translational Psychiatry
Post-traumatic stress disorder (PTSD) develops in only some people following trauma exposure, but the mechanisms differentially explaining risk versus resilience remain largely unknown. PTSD is heritable but candidate gene studies and genome-wide association studies (GWAS) have identified only a modest number of genes that reliably contribute to PTSD. New gene-based methods may help identify additional genes that increase risk for PTSD development or severity. We applied gene-based testing to GWAS data from the Grady Trauma Project (GTP), a primarily African American cohort, and identified two
View details →DOI: 10.1038/tp.2016.69Cited by 75 Replication FailureOpen accessMedicine
Wai‐Ping Yau, Allen A. Mitchell, Kueiyu Joshua Lin et al. · 2013 · American Journal of Epidemiology
Previous studies suggested that early pregnancy exposure to specific oral decongestants increases the risks of several birth defects. Using January 1993-January 2010 data from the Slone Epidemiology Center Birth Defects Study, we tested…
View details →DOI: 10.1093/aje/kws427Cited by 74 Replication FailureOpen accessPsychology
Oliver Hauser, Francesca Gino, Michael I. Norton · 2018 · Mind & Society
Nudges have become a popular tool for behaviour change; but, some interventions fail to replicate, even when the identical, previously successful intervention is used. One cause of this problem is that people default to using some of or all of the previously-successful existing nudges for any problem—the “kitchen sink” approach. We argue that the success of an intervention depends on understanding people’s current behaviour and beliefs to ensure that any nudge will actually “budge” them from their current beliefs. We introduce the Beliefs–Barriers–Context model, with three components: understa
View details →DOI: 10.1007/s11299-019-00200-9Cited by 73 Replication FailureOpen accessMedicine
Kristen P. Lindgren, Reínout W. Wiers, Bethany A. Teachman et al. · 2015 · PLoS ONE
There is preliminary evidence that approach avoid training can shift implicit alcohol associations and improve treatment outcomes. We sought to replicate and extend those findings in US undergraduate social drinkers (Study 1) and at-risk drinkers (Study 2). Three adaptations of the approach avoid task (AAT) were tested. The first adaptation - the approach avoid training - was a replication and targeted implicit alcohol approach associations. The remaining two adaptations - the general identity and personalized identity trainings - targeted implicit drinking identity associations, which are rob
View details →DOI: 10.1371/journal.pone.0134642Cited by 69 Replication FailureOpen accessPsychology
Andreas Lachner, Vincent Hoogerheide, Tamara van Gog et al. · 2021 · Educational Psychology Review
Abstract Teaching the contents of study materials by providing explanations to fellow students can be a beneficial instructional activity. A learning-by-teaching effect can also occur when students provide explanations to a real, remote, or even fictitious audience that cannot be interacted with. It is unclear, however, which underlying mechanisms drive learning by non-interactive teaching effects and why several recent studies did not replicate this effect. This literature review aims to shed light on when and why learning by non-interactive teaching works. First, we review the empirical lite
View details →DOI: 10.1007/s10648-021-09643-4Cited by 69 