e-ISSN: Pending

Browse the failure-mode index

403 real negative results, null findings, and replication failures · Replication Failure. Search the index →

WASTE indexes published research — it does not host or republish full papers. Each entry is a metadata record compiled from open scholarly databases; the abstract is shown in full only where the paper is openly licensed, otherwise a short excerpt under fair use. Classifications are automated and approximate.

Replication FailureOpen accessDecision Sciences

Estimating the reproducibility of psychological science

Alexander A. Aarts · 2015 · Science

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using…

View details →
Replication FailureOpen accessMedicine

A Randomized Trial of Bevacizumab for Newly Diagnosed Glioblastoma

Mark R. Gilbert, James J. Dignam, Terri S. Armstrong et al. · 2014 · New England Journal of Medicine

BACKGROUND: Concurrent treatment with temozolomide and radiotherapy followed by maintenance temozolomide is the standard of care for patients with newly diagnosed glioblastoma. Bevacizumab, a humanized monoclonal antibody against vascular…

View details →
Replication FailureOpen accessMedicine

Effects of Dalcetrapib in Patients with a Recent Acute Coronary Syndrome

Gregory G. Schwartz, Anders Olsson, Markus Abt et al. · 2012 · New England Journal of Medicine

BACKGROUND: In observational analyses, higher levels of high-density lipoprotein (HDL) cholesterol have been associated with a lower risk of coronary heart disease events. However, whether raising HDL cholesterol levels therapeutically…

View details →
Replication FailureOpen accessNeuroscience

Reproducible brain-wide association studies require thousands of individuals

Scott Marek, Brenden Tervo‐Clemmens, Finnegan J. Calabro et al. · 2022 · Nature

Abstract Magnetic resonance imaging (MRI) has transformed our understanding of the human brain through well-replicated mapping of abilities to specific structures (for example, lesion studies) and functions 1–3 (for example, task functional MRI (fMRI)). Mental health research and care have yet to realize similar advances from MRI. A primary challenge has been replicating associations between inter-individual differences in brain structure or function and complex cognitive or mental health phenotypes (brain-wide association studies (BWAS)). Such BWAS have typically relied on sample sizes approp

View details →
Replication FailureOpen accessMedicine

Trial of Anifrolumab in Active Systemic Lupus Erythematosus

Eric F. Morand, Richard Furie, Yoshiya Tanaka et al. · 2019 · New England Journal of Medicine

BACKGROUND: Anifrolumab, a human monoclonal antibody to type I interferon receptor subunit 1 investigated for the treatment of systemic lupus erythematosus (SLE), did not have a significant effect on the primary end point in a previous…

View details →
Replication FailureOpen accessSocial Sciences

Investigating Variation in Replicability

Richard Klein, Kate A. Ratliff, Michelangelo Vianello et al. · 2014 · Social Psychology

Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344…

View details →
Replication FailureOpen accessMedicine

Trial of Solanezumab for Mild Dementia Due to Alzheimer’s Disease

Lawrence S. Honig, Bruno Vellas, Mark Woodward et al. · 2018 · New England Journal of Medicine

BACKGROUND: Alzheimer's disease is characterized by amyloid-beta (Aβ) plaques and neurofibrillary tangles. The humanized monoclonal antibody solanezumab was designed to increase the clearance from the brain of soluble Aβ, peptides that may…

View details →
Replication FailureOpen accessMedicine

A Randomized Trial of Convalescent Plasma in Covid-19 Severe Pneumonia

Ventura Simonovich, Leandro Daniel Burgos Pratx, Paula Scibona et al. · 2020 · New England Journal of Medicine

BACKGROUND: Convalescent plasma is frequently administered to patients with Covid-19 and has been reported, largely on the basis of observational data, to improve clinical outcomes. Minimal data are available from adequately powered…

View details →
Replication FailureOpen accessComputer Science

Leakage and the reproducibility crisis in machine-learning-based science

Sayash Kapoor, Arvind Narayanan · 2023 · Patterns

Machine-learning (ML) methods have gained prominence in the quantitative sciences. However, there are many known methodological pitfalls, including data leakage, in ML-based science. We systematically investigate reproducibility issues in ML-based science. Through a survey of literature in fields that have adopted ML methods, we find 17 fields where leakage has been found, collectively affecting 294 papers and, in some cases, leading to wildly overoptimistic conclusions. Based on our survey, we introduce a detailed taxonomy of eight types of leakage, ranging from textbook errors to open resear

View details →
Replication FailureOpen accessMedicine

Randomized Trial of Primary PCI with or without Routine Manual Thrombectomy

Sanjit S. Jolly, John A. Cairns, Salim Yusuf et al. · 2015 · New England Journal of Medicine

BACKGROUND: During primary percutaneous coronary intervention (PCI), manual thrombectomy may reduce distal embolization and thus improve microvascular perfusion. Small trials have suggested that thrombectomy improves surrogate and clinical…

View details →
Replication FailureOpen accessMedicine

Azithromycin in patients admitted to hospital with COVID-19 (RECOVERY): a randomised, controlled, open-label, platform trial

Eugenia Abaleke, Mustafa Abbas, Sadia Abbasi et al. · 2021 · The Lancet

BACKGROUND: Azithromycin has been proposed as a treatment for COVID-19 on the basis of its immunomodulatory actions. We aimed to evaluate the safety and efficacy of azithromycin in patients admitted to hospital with COVID-19. METHODS: In this randomised, controlled, open-label, adaptive platform trial (Randomised Evaluation of COVID-19 Therapy [RECOVERY]), several possible treatments were compared with usual care in patients admitted to hospital with COVID-19 in the UK. The trial is underway at 176 hospitals in the UK. Eligible and consenting patients were randomly allocated to either usual st

View details →
Replication FailureOpen accessNursing

Randomised placebo-controlled trial of teduglutide in reducing parenteral nutrition and/or intravenous fluid requirements in patients with short bowel syndrome

Palle Bekker Jeppesen, Richard Gilroy, M. Pertkiewicz et al. · 2011 · Gut

BACKGROUND AND AIMS: Teduglutide, a GLP-2 analogue, may restore intestinal structural and functional integrity by promoting repair and growth of the mucosa and reducing gastric emptying and secretion, thereby increasing fluid and nutrient…

View details →
Replication FailureOpen accessDecision Sciences

Inferential Statistics as Descriptive Statistics: There Is No Replication Crisis if We Don’t Expect Replication

Valentin Amrhein, David Trafimow, Sander Greenland · 2019 · The American Statistician

Statistical inference often fails to replicate. One reason is that many results may be selected for drawing inference because some threshold of a statistic like the P-value was crossed, leading to biased reported effect sizes. Nonetheless,…

View details →
Replication FailureOpen accessPsychology

Contextual sensitivity in scientific reproducibility

Jay J. Van Bavel, Peter Mende‐Siedlecki, William J. Brady et al. · 2016 · Proceedings of the National Academy of Sciences

In recent years, scientists have paid increasing attention to reproducibility. For example, the Reproducibility Project, a large-scale replication attempt of 100 studies published in top psychology journals found that only 39% could be…

View details →
Replication FailureOpen accessDecision Sciences

Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition

Tom E Hardwicke, Maya B. Mathur, Kyle MacDonald et al. · 2018 · Royal Society Open Science

Access to data is a critical feature of an efficient, progressive and ultimately self-correcting scientific ecosystem. But the extent to which in-principle benefits of data sharing are realized in practice is unclear. Crucially, it is largely unknown whether published findings can be reproduced by repeating reported analyses upon shared data (‘analytic reproducibility’). To investigate this, we conducted an observational evaluation of a mandatory open data policy introduced at the journal Cognition . Interrupted time-series analyses indicated a substantial post-policy increase in data availabl

View details →
Replication FailurePsychology

Priming, Replication, and the Hardest Science

Joseph Cesario · 2014 · Perspectives on Psychological Science

Concerns have been raised recently about the replicability of behavioral priming effects, and calls have been issued to identify priming methodologies with effects that can be obtained in any context and with any population. I argue that…

View details →
Replication FailureOpen accessMedicine

Clinical Efficacy of LivPro® Herbal Medicine among Hepatitis C Patients Pakistan: Longitudinal Interventional Study

Irfan Shahîd, Kashif Maqbool Khan, Tahir Mehmood Khan et al. · 2021 · Archives of Pharmacy Practice

The current study aims to investigate the hepatoprotective effects of LivPro® among hepatitis C patients. An interventional study was performed among n=89 hepatitis C patients. The duration of the study was 3 months and the assessment…

View details →
Replication FailureOpen accessDecision Sciences

Nonreplicable publications are cited more than replicable ones

Marta Serra-García, Uri Gneezy · 2021 · Science Advances

We use publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the…

View details →
Replication FailureOpen accessBiochemistry, Genetics and Molecular Biology

Blood metabolite markers of preclinical Alzheimer's disease in two longitudinally followed cohorts of older individuals

Ramon Casanova, Sudhir Varma, Brittany Simpson et al. · 2016 · Alzheimer s & Dementia

INTRODUCTION: Recently, quantitative metabolomics identified a panel of 10 plasma lipids that were highly predictive of conversion to Alzheimer's disease (AD) in cognitively normal older individuals (n = 28, area under the curve [AUC] =…

View details →
Replication FailureOpen accessNursing

Selenium supplementation for the primary prevention of cardiovascular disease

Karen Rees, Louise Hartley, Camilla Day et al. · 2013 · Cochrane Database of Systematic Reviews

BACKGROUND: Selenium is a key component of a number of selenoproteins which protect against oxidative stress and have the potential to prevent chronic diseases including cardiovascular disease (CVD). However, observational studies have…

View details →
Replication FailureOpen accessComputer Science

Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing

Luana Micallef, Pierre Dragicevic, Jean‐Daniel Fekete · 2012 · IEEE Transactions on Visualization and Computer Graphics

People have difficulty understanding statistical information and are unaware of their wrong judgments, particularly in Bayesian reasoning. Psychology studies suggest that the way Bayesian problems are represented can impact comprehension,…

View details →
Replication FailureOpen accessMedicine

Mediterranean-type diet and brain structural change from 73 to 76 years in a Scottish cohort

Michelle Luciano, Janie Corley, Simon R. Cox et al. · 2017 · Neurology

OBJECTIVE: To assess the association between Mediterranean-type diet (MeDi) and change in brain MRI volumetric measures and mean cortical thickness across a 3-year period in older age (73-76 years). METHODS: We focused on 2 longitudinal brain volumes (total and gray matter; n = 401 and 398, respectively) plus a longitudinal measurement of cortical thickness (n = 323), for which the previous cross-sectional evidence of an association with the MeDi was strongest. Adherence to the MeDi was calculated from data gathered from a food frequency questionnaire at age 70, 3 years prior to the baseline i

View details →
Replication FailureOpen accessMathematics

Translating evidence into practice: eligibility criteria fail to eliminate clinically significant differences between real-world and study populations

Amelia Averitt, Chunhua Weng, Patrick Ryan et al. · 2020 · npj Digital Medicine

Randomized controlled trials (RCTs) are regarded as the most reputable source of evidence. In some studies, factors beyond the intervention itself may contribute to the measured effect, an occurrence known as heterogeneity of treatment effect (HTE). If the RCT population differs from the real-world population on factors that induce HTE, the trials effect will not replicate. The RCTs eligibility criteria should identify the sub-population in which its evidence will replicate. However, the extent to which the eligibility criteria identify the appropriate population is unknown, which raises conce

View details →