A searchable index of real negative results, null findings, and replication failures from the published literature — so you can learn what didn't work before repeating it.
WASTE indexes published research — it does not host or republish full papers. Each entry is a metadata record (title, authors, DOI) compiled from open scholarly databases, with the abstract shown in full only where the paper is openly licensed (e.g. Creative Commons); otherwise a short excerpt is shown for reference under fair use. WASTE classifies each work by failure type; classifications are automated and approximate.
403 results in Replication Failure · page 1 of 14
Alexander A. Aarts · 2015 · Science
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using…
Mark R. Gilbert, James J. Dignam, Terri S. Armstrong et al. · 2014 · New England Journal of Medicine
BACKGROUND: Concurrent treatment with temozolomide and radiotherapy followed by maintenance temozolomide is the standard of care for patients with newly diagnosed glioblastoma. Bevacizumab, a humanized monoclonal antibody against vascular…
Gregory G. Schwartz, Anders Olsson, Markus Abt et al. · 2012 · New England Journal of Medicine
BACKGROUND: In observational analyses, higher levels of high-density lipoprotein (HDL) cholesterol have been associated with a lower risk of coronary heart disease events. However, whether raising HDL cholesterol levels therapeutically…
Scott Marek, Brenden Tervo‐Clemmens, Finnegan J. Calabro et al. · 2022 · Nature
Abstract Magnetic resonance imaging (MRI) has transformed our understanding of the human brain through well-replicated mapping of abilities to specific structures (for example, lesion studies) and functions 1–3 (for example, task functional MRI (fMRI)). Mental health research and care have yet to realize similar advances from MRI. A primary challenge has been replicating associations between inter-individual differences in brain structure or function and complex cognitive or mental health phenotypes (brain-wide association studies (BWAS)). Such BWAS have typically relied on sample sizes approp
Eric F. Morand, Richard Furie, Yoshiya Tanaka et al. · 2019 · New England Journal of Medicine
BACKGROUND: Anifrolumab, a human monoclonal antibody to type I interferon receptor subunit 1 investigated for the treatment of systemic lupus erythematosus (SLE), did not have a significant effect on the primary end point in a previous…
Richard Klein, Kate A. Ratliff, Michelangelo Vianello et al. · 2014 · Social Psychology
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344…
Mark R. Gilbert, Meihua Wang, Kenneth Aldape et al. · 2013 · Journal of Clinical Oncology
PURPOSE: Radiotherapy with concomitant and adjuvant temozolomide is the standard of care for newly diagnosed glioblastoma (GBM). O(6)-methylguanine-DNA methyltransferase (MGMT) methylation status may be an important determinant of…
Lawrence S. Honig, Bruno Vellas, Mark Woodward et al. · 2018 · New England Journal of Medicine
BACKGROUND: Alzheimer's disease is characterized by amyloid-beta (Aβ) plaques and neurofibrillary tangles. The humanized monoclonal antibody solanezumab was designed to increase the clearance from the brain of soluble Aβ, peptides that may…
Ventura Simonovich, Leandro Daniel Burgos Pratx, Paula Scibona et al. · 2020 · New England Journal of Medicine
BACKGROUND: Convalescent plasma is frequently administered to patients with Covid-19 and has been reported, largely on the basis of observational data, to improve clinical outcomes. Minimal data are available from adequately powered…
Sayash Kapoor, Arvind Narayanan · 2023 · Patterns
Machine-learning (ML) methods have gained prominence in the quantitative sciences. However, there are many known methodological pitfalls, including data leakage, in ML-based science. We systematically investigate reproducibility issues in ML-based science. Through a survey of literature in fields that have adopted ML methods, we find 17 fields where leakage has been found, collectively affecting 294 papers and, in some cases, leading to wildly overoptimistic conclusions. Based on our survey, we introduce a detailed taxonomy of eight types of leakage, ranging from textbook errors to open resear
Sanjit S. Jolly, John A. Cairns, Salim Yusuf et al. · 2015 · New England Journal of Medicine
BACKGROUND: During primary percutaneous coronary intervention (PCI), manual thrombectomy may reduce distal embolization and thus improve microvascular perfusion. Small trials have suggested that thrombectomy improves surrogate and clinical…
F.G.R. Fowkes · 2010 · JAMA
CONTEXT: A low ankle brachial index (ABI) indicates atherosclerosis and an increased risk of cardiovascular and cerebrovascular events. Screening for a low ABI can identify an asymptomatic higher risk group potentially amenable to…
Eugenia Abaleke, Mustafa Abbas, Sadia Abbasi et al. · 2021 · The Lancet
BACKGROUND: Azithromycin has been proposed as a treatment for COVID-19 on the basis of its immunomodulatory actions. We aimed to evaluate the safety and efficacy of azithromycin in patients admitted to hospital with COVID-19. METHODS: In this randomised, controlled, open-label, adaptive platform trial (Randomised Evaluation of COVID-19 Therapy [RECOVERY]), several possible treatments were compared with usual care in patients admitted to hospital with COVID-19 in the UK. The trial is underway at 176 hospitals in the UK. Eligible and consenting patients were randomly allocated to either usual st
Patrick Mismetti, Silvy Laporte, Olivier Pellerin et al. · 2015 · JAMA
IMPORTANCE: Although retrievable inferior vena cava filters are frequently used in addition to anticoagulation in patients with acute venous thromboembolism, their benefit-risk ratio is unclear. OBJECTIVE: To evaluate the efficacy and…
Palle Bekker Jeppesen, Richard Gilroy, M. Pertkiewicz et al. · 2011 · Gut
BACKGROUND AND AIMS: Teduglutide, a GLP-2 analogue, may restore intestinal structural and functional integrity by promoting repair and growth of the mucosa and reducing gastric emptying and secretion, thereby increasing fluid and nutrient…
Valentin Amrhein, David Trafimow, Sander Greenland · 2019 · The American Statistician
Statistical inference often fails to replicate. One reason is that many results may be selected for drawing inference because some threshold of a statistic like the P-value was crossed, leading to biased reported effect sizes. Nonetheless,…
Jay J. Van Bavel, Peter Mende‐Siedlecki, William J. Brady et al. · 2016 · Proceedings of the National Academy of Sciences
In recent years, scientists have paid increasing attention to reproducibility. For example, the Reproducibility Project, a large-scale replication attempt of 100 studies published in top psychology journals found that only 39% could be…
Tom E Hardwicke, Maya B. Mathur, Kyle MacDonald et al. · 2018 · Royal Society Open Science
Access to data is a critical feature of an efficient, progressive and ultimately self-correcting scientific ecosystem. But the extent to which in-principle benefits of data sharing are realized in practice is unclear. Crucially, it is largely unknown whether published findings can be reproduced by repeating reported analyses upon shared data (‘analytic reproducibility’). To investigate this, we conducted an observational evaluation of a mandatory open data policy introduced at the journal Cognition . Interrupted time-series analyses indicated a substantial post-policy increase in data availabl
Joseph Cesario · 2014 · Perspectives on Psychological Science
Concerns have been raised recently about the replicability of behavioral priming effects, and calls have been issued to identify priming methodologies with effects that can be obtained in any context and with any population. I argue that…
Gabrielle Kingsley, Anna Kowalczyk, Helen Taylor et al. · 2012 · Lara D. Veeken
OBJECTIVE: MTX is widely used to treat synovitis in PsA without supporting trial evidence. The aim of our study was to test the value of MTX in the first large randomized placebo-controlled trial (RCT) in PsA. METHODS: A 6-month…
Irfan Shahîd, Kashif Maqbool Khan, Tahir Mehmood Khan et al. · 2021 · Archives of Pharmacy Practice
The current study aims to investigate the hepatoprotective effects of LivPro® among hepatitis C patients. An interventional study was performed among n=89 hepatitis C patients. The duration of the study was 3 months and the assessment…
Michelle L. O’Donoghue, Ruchira Glaser, Matthew A. Cavender et al. · 2016 · JAMA
IMPORTANCE: p38 Mitogen-activated protein kinase (MAPK)-stimulated inflammation is implicated in atherogenesis, plaque destabilization, and maladaptive processes in myocardial infarction (MI). Pilot data in a phase 2 trial in non-ST…
Marta Serra-García, Uri Gneezy · 2021 · Science Advances
We use publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the…
Ramon Casanova, Sudhir Varma, Brittany Simpson et al. · 2016 · Alzheimer s & Dementia
INTRODUCTION: Recently, quantitative metabolomics identified a panel of 10 plasma lipids that were highly predictive of conversion to Alzheimer's disease (AD) in cognitively normal older individuals (n = 28, area under the curve [AUC] =…
Karen Rees, Louise Hartley, Camilla Day et al. · 2013 · Cochrane Database of Systematic Reviews
BACKGROUND: Selenium is a key component of a number of selenoproteins which protect against oxidative stress and have the potential to prevent chronic diseases including cardiovascular disease (CVD). However, observational studies have…
Briana B. Morrison, Lauren E. Margulieux, Mark Guzdial · 2015
Recent empirical results suggest that the instructional material used to teach computing may actually overload students' cognitive abilities. Better designed materials may enhance learning by reducing unnecessary load. Subgoal labels have…
Luana Micallef, Pierre Dragicevic, Jean‐Daniel Fekete · 2012 · IEEE Transactions on Visualization and Computer Graphics
People have difficulty understanding statistical information and are unaware of their wrong judgments, particularly in Bayesian reasoning. Psychology studies suggest that the way Bayesian problems are represented can impact comprehension,…
Dermot Lynott, Katherine S. Corker, Jessica Wortman et al. · 2014 · Social Psychology
We report the results of three high-powered, independent replications of Study 2 from Williams and Bargh (2008) . Participants evaluated hot or cold instant therapeutic packs before choosing a reward for participation that was framed as a…
Michelle Luciano, Janie Corley, Simon R. Cox et al. · 2017 · Neurology
OBJECTIVE: To assess the association between Mediterranean-type diet (MeDi) and change in brain MRI volumetric measures and mean cortical thickness across a 3-year period in older age (73-76 years). METHODS: We focused on 2 longitudinal brain volumes (total and gray matter; n = 401 and 398, respectively) plus a longitudinal measurement of cortical thickness (n = 323), for which the previous cross-sectional evidence of an association with the MeDi was strongest. Adherence to the MeDi was calculated from data gathered from a food frequency questionnaire at age 70, 3 years prior to the baseline i
Amelia Averitt, Chunhua Weng, Patrick Ryan et al. · 2020 · npj Digital Medicine
Randomized controlled trials (RCTs) are regarded as the most reputable source of evidence. In some studies, factors beyond the intervention itself may contribute to the measured effect, an occurrence known as heterogeneity of treatment effect (HTE). If the RCT population differs from the real-world population on factors that induce HTE, the trials effect will not replicate. The RCTs eligibility criteria should identify the sub-population in which its evidence will replicate. However, the extent to which the eligibility criteria identify the appropriate population is unknown, which raises conce