Methods Dead-EndOpen access
Tucker, Todd · 2013
A major question in investment treaty arbitration is whether it is biased against developing countries. This paper replicates the results from a frequently cited paper on this question (Franck, 2009) that failed to find statistically…
View details →DOI: 10.7910/dvn/w5rnhc Negative / Null Result ReportOpen access
Masanori Kobayashi, Yasunori Kinosada · 2022
This study try replicate that value enhances associative memory when the binding of item features is optimized. Although our experiment 1 (online) failed to replicate previous findings, it is possible that learning instruction is difficult…
View details →DOI: 10.17605/osf.io/4rpy7 Negative / Null Result ReportOpen accessAgriculture
Mufty K., Shlier Mahmood · 2021 · مجلة جامعة كركوك للعلوم الزراعية
This study was conducted during growing season 2019-2020, in order to evaluate the impact of organic fertilizers on growth and development of two strawberry cultivars (Fragaria X ananassa Duch.). where two different organic fertilizers humic acid and seaweed with three levels (0.0, 2.0 and 4.0) mL.L-1 were foliar sprayed at different growth stages of two strawberry cultivars has been used; Albion and Rubygem. Randomized complete block design (RCBD) was implemented with three replications. The results show that Robygem was recorded the higher leaf area (96.27 cm2), root fresh weight (61.25 g) a
View details →DOI: 10.58928/ku21.12405 Negative / Null Result ReportOpen accessTherapeutics. Pharmacology
M Dadvand Sarab, H Naghdi Badi, M Nasri et al. · 2008 · Journal of Medicinal Plants
Background: Basil (Ocimum basilicum L.) is a valuable medicinal and aromatic plant which is cultivated throughout the world. Therefore, it is necessary to determine effect of important agronomical factors on quality and quantity of its volatile oil. Objective: To determine plant density and nitrogen fertilization effects on quality and quantity yield of basil. Method: This study was done in Research farm of ACECR, Institute of Medicinal Plants & Natural Products Research in 2006 on the base of factorial experiment in randomized complete block design with four replications. All possible combina
Negative / Null Result ReportMedicine
Curtis, McCrary, Daud et al. · 2026 · Cardiovascular journal of Africa
Epstein-Barr virus (EBV) affects greater than 95% of the global population, and when acquired at an early age, results in poor control of viral replication and increased risk to subsequent chronic illnesses. To analye the association…
View details →DOI: 10.5830/cvja-2025-109 Negative / Null Result ReportOpen accessComputer Science
Amador Durán, Pablo Fernández, Beatriz Bernárdez et al. · 2023 · arXiv
Context. Software Engineering (SE) has low female representation due to gender bias that men are better at programming. Pair programming (PP) is common in industry and can increase student interest in SE, especially women; but if gender bias affects PP, it may discourage women from joining the field. Objective. We explore gender bias in PP. In a remote setting where students cannot see their peers' gender, we study how perceived productivity, technical competency and collaboration/interaction behaviors of SE students vary by perceived gender of their remote partner. Method. We developed an onl
Negative / Null Result ReportOpen accessMathematics
Samuel Pawel, Rachel Heyard, Charlotte Micheloud et al. · 2023 · arXiv
In several large-scale replication projects, statistically non-significant results in both the original and the replication study have been interpreted as a "replication success". Here we discuss the logical problems with this approach: Non-significance in both studies does not ensure that the studies provide evidence for the absence of an effect and "replication success" can virtually always be achieved if the sample sizes are small enough. In addition, the relevant error rates are not controlled. We show how methods, such as equivalence testing and Bayes factors, can be used to adequately qu
Negative / Null Result Report
Kirill Zhirkov, Robert H. Brehm · 2025 · Research & Politics
Activists and politicians often express a belief that the language used to describe immigrant populations, such as “illegal” vs. “undocumented,” can impact policy opinions. Existing experimental studies, however, have found relatively…
View details →DOI: 10.1177/20531680251355233 Negative / Null Result Report
Jennifer Nguyen, Ranjith Anand, Guy-Franck Richard et al. · 2012 · The FASEB Journal
Trinucleotide repeats form secondary DNA structures that can lead to chromosomal instability, breakage, and fork stalling during replication. Srs2, a non‐replicative helicase, anti‐recombinase that can displace Rad51, and interacts with…
View details →DOI: 10.1096/fasebj.26.1_supplement.741.2 Negative / Null Result Report
David Colaço, John Bickle, Bradley Walters · 2022 · Biology & Philosophy
Abstract Scientists often respond to failures to replicate by citing differences between the experimental components of an original study and those of its attempted replication. In this paper, we investigate these purported mismatch…
View details →DOI: 10.1007/s10539-022-09873-y Negative / Null Result ReportMedicine
Schauer JM · 2023 · Multivariate behavioral research
A prominent approach to studying the replication crisis has been to conduct replications of several different scientific findings as part of the same research effort. The reported proportion of findings that these programs determined…
View details →DOI: 10.1080/00273171.2022.2066500 Negative / Null Result ReportOpen accessMathematics
Fintan Costello, Paul Watts · 2022 · arXiv
There is a well-known problem in Null Hypothesis Significance Testing: many statistically significant results fail to replicate in subsequent experiments. We show that this problem arises because standard `point-form null' significance tests consider only within-experiment but ignore between-experiment variation, and so systematically underestimate the degree of random variation in results. We give an extension to standard significance testing that addresses this problem by analysing both within- and between-experiment variation. This `distributional null' approach does not underestimate exper
Negative / Null Result ReportOpen accessComputer Science
Bob de Ruiter · 2023 · arXiv
In many fields of experimental science, papers that failed to replicate continue to be cited as a result of the poor discoverability of replication studies. As a first step to creating a system that automatically finds replication studies for a given paper, 334 replication studies and 344 replicated studies were collected. Replication studies could be identified in the dataset based on text content at a higher rate than chance (AUROC = 0.886). Additionally, successful replication studies could be distinguished from failed replication studies at a higher rate than chance (AUROC = 0.664).
Negative / Null Result ReportOpen accessComputer Science
James Kirby, Ioana Krehan, Michele Gubian · 2026 · arXiv
This study examines the extent to which the wav2vec2.0 architecture exhibits evidence of compensation for phonological context. We conducted a pseudo-replication of a perceptional compensation experiment on Mandarin Chinese tones, and compared the embedding similarities and probing classifier outputs between a purely self-supervised pre-trained model and a model fine-tuned for Mandarin ASR. No evidence of compensation was found in the embedding similarities of the purely pre-trained model. Probing classifiers showed some evidence of compensation in addition to the expected layer-wise improveme
Negative / Null Result ReportOpen accessHistory of scholarship and learning. The humanities
Keljanović Anđela D. · 2021 · Zbornik Radova Filozofskog Fakulteta u Prištini
At the time when social psychologists believed they could be proud of their discipline, there was the devastating news that Diederik Stapel had committed a major scientific fraud. This event coincided with the start of the discussion on trust in psychological findings. It was soon followed by the report of a series of nine studies that failed to replicate the 'professor's study'. These replication results were astounding due to earlier reports of successful replications. Due to the crisis of confidence in the results of field research, the Open Science Collaboration subsequently replicated 100
View details →DOI: 10.5937/zrffp51-24851 Negative / Null Result ReportOpen accessPsychology
Singh, Anjali, Durand, Guillaume · 2022 · Tutorials in Quantitative Methods for Psychology
This study is a replication of Andreassen and colleagues (2013) [The relationships between behavioral addictions and the five-factor model of personality. Journal of Behavioral Addictions, 2(2), 90-99]. We partially replicated the findings of the original study. Our results support the role of personality, particularly conscientiousness, in predicting behavioral addictions, such as video game, Internet, and mobile phone addiction. However, we failed to replicate the same pattern of personality traits for each behavioral addiction.
View details →DOI: 10.20982/tqmp.18.1.r001 Negative / Null Result ReportOpen accessMicrobiology
Miao Jiang, Pekka Kolehmainen, Laura Kakkola et al. · 2021 · Microbiology Spectrum
ABSTRACT The primary target organ of coronavirus disease 2019 (COVID-19) infection is the respiratory tract. Currently, there is limited information on the ability of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) to infect and regulate innate immunity in human immune cells and lung epithelial cells. Here, we compared the ability of four Finnish isolates of SARS-CoV-2 from COVID-19 patients to replicate and induce interferons (IFNs) and other cytokines in different human cells. All isolates failed to replicate in dendritic cells, macrophages, monocytes, and lymphocytes, and no in
View details →DOI: 10.1128/spectrum.00774-21 Negative / Null Result ReportOpen accessSocial Sciences
Christine M. Smith, Paulina Dzik, Errin Fornicola · 2019 · Social Influence
Using the lens of Deindividuation Theory, Leon Mann explored the formation of baiting crowds in a small sample of public suicides/suicide attempts. Instead of attempting to prevent the suicide, baiting crowds encourage the victim to jump. Our aim was to replicate Mann's study with a larger more diverse sample of suicide attempts and a broadened theoretical lens (Frustration-Aggression). Using ProQuest, we identified 152 public suicide attempts reported in English language newspapers and failed to replicate Mann’s findings. Rather, baiting crowd formation was associated with variables that incr
View details →DOI: 10.1080/15534510.2019.1669488 Negative / Null Result ReportOpen accessScience
Veronica Boyce, Maya Mathur, Michael C. Frank · 2023 · Royal Society Open Science
Cumulative scientific progress requires empirical results that are robust enough to support theory construction and extension. Yet in psychology, some prominent findings have failed to replicate, and large-scale studies suggest replicability issues are widespread. The identification of predictors of replication success is limited by the difficulty of conducting large samples of independent replication experiments, however: most investigations reanalyse the same set of [Formula: see text]. We introduce a new dataset of 176 replications from students in a graduate-level methods course. Replicati
View details →DOI: 10.1098/rsos.231240 Negative / Null Result ReportOpen accessSocial Sciences
Mark Nieuwenstein, Hedderik van Rijn · 2012 · Judgment and Decision Making
According to the deliberation without attention (DWA) hypothesis, people facing a difficult choice will make a better decision after a period of distraction than after an equally long period of conscious deliberation, an effect referred to as the unconscious thought advantage (UTA). The status of the DWA hypothesis is controversial, as many studies have tried but failed to replicate the UTA. Here, we report a series of experiments that sought to identify the conditions under which the UTA can be replicated. Our starting point was a recent meta-analysis that identified the conditions under whic
Negative / Null Result ReportOpen accessMedicine
Abraham D. Flaxman, Riley Hazard, Ian Riley et al. · 2020 · BMC Medicine
Abstract We recently published in BMC Medicine an evaluation of the comparative diagnostic performance of InSilicoVA, a software to map the underlying causes of death from verbal autopsy interviews. The developers of this software claim to have failed to replicate our results and appear to have also failed to locate our replication archive for this work. In this Correspondence, we provide feedback on how this might have been done more usefully and offer some suggestions to improve future attempts at reproducible research. We also offer an alternative interpretation of the results presented by
View details →DOI: 10.1186/s12916-020-01517-w Negative / Null Result ReportOpen accessLanguage and Literature
Elisa Scerrati, Zachary Estes · 2025 · Language and Cognition
The spatial interference effect, whereby words with implicit spatial associations (e.g., ‘bird’) hinder identification of unrelated visual targets (e.g., a square) at the associated locations (i.e., at the top of a display), has been demonstrated many times in English, although it has failed to replicate several times in Italian. The current study tested whether the replication failures in Italian may be due to insufficient semantic processing of the words. Indeed, while languages with highly inconsistent pronunciations, such as English, are more likely to involve semantic processing during wo
View details →DOI: 10.1017/langcog.2025.10031 Negative / Null Result ReportOpen accessNeurosciences. Biological psychiatry. Neuropsychiatry
Tom A. de Graaf, Tom A. de Graaf, Alexander T. Sack et al. · 2018 · Frontiers in Neuroscience
Experiments often challenge the null hypothesis that an intervention, for instance application of non-invasive brain stimulation (NIBS), has no effect on an outcome measure. In conventional statistics, a positive result rejects that hypothesis, but a null result is meaningless. Informally, however, researchers often do find null results meaningful to a greater or lesser extent. We present a model to guide interpretation of null results in NIBS research. Along a “gradient of surprise,” from Replication nulls through Exploration nulls to Hypothesized nulls, null results can be less or more surpr
View details →DOI: 10.3389/fnins.2018.00915 Negative / Null Result ReportMedicine
Platts CR, Groh AM, Runze J et al. · 2026 · Attachment & human development
Initial molecular genetic studies identified specific genes that contribute to variation in associations between maternal sensitivity and infant attachment, but these findings from small samples failed to replicate in larger-sample…
View details →DOI: 10.1080/14616734.2026.2690651 Negative / Null Result Report
Boyce V, Mathur MB, Frank MC · 2023 · Preprint
Cumulative scientific progress requires empirical results that are robust enough to support theory construction and extension. Yet in psychology, some prominent findings have failed to replicate, and large-scale studies suggest…
View details →DOI: 10.31234/osf.io/dpyn6 Negative / Null Result Report
Pitz V, Makarious M, Bandrés-Ciga S et al. · 2023 · Preprint
Abstract Objective Although many rare variants have been reportedly associated with Parkinson’s disease (PD), many have not been replicated or have failed to replicate. Here, we conduct a large-scale replication of rare PD variants.…
View details →DOI: 10.21203/rs.3.rs-2743857/v1 Negative / Null Result Report
Forestier C, de Chanaleilles M, Boisgontier MP et al. · 2021 · Preprint
The replication crisis in psychology has led to question popular phenomena such as ego depletion, which has been criticized after studies failed to replicate. Here, we describe limitations in the literature that contributed to these…
View details →DOI: 10.31234/osf.io/spm9a Negative / Null Result Report
Lazarevic LB, Wagge JR, Buchanan EM et al. · 2023 · Preprint
The present study presents the results of a collaborative registered replication of Griskevicius et al. (2010, Experiment 1). As part of the Collaborative Replication and Education Project, 24 student groups from six countries (N = 3,774)…
View details →DOI: 10.31234/osf.io/sfmz8_v1 Negative / Null Result ReportOpen accessAgriculture
Akari Edy, Resti Puspa Kartika Sari, Hidayat Pujisiswanto · 2021 · Jurnal Agrotropika
Lampung is a center for maize and cattle production. This study aims to determine (1) the dosage of liquid bio-slurry fertilizer which is effective in increasing the growth and yield of maize, (2) the correct split application time of liquid bio-slurry, (3) the interaction between the dose of liquid bio-slurry fertilizer and time of split application on the growth and yield of maize. The research was conducted in Fajar Baru Village, Jati Agung District, South Lampung Regency. The study used a randomized block design (RBD) that arranged in factorial (4x2) with three replications. The first fact
View details →DOI: 10.23960/ja.v20i1.4755 Negative / Null Result ReportOpen accessDemography. Population. Vital events
Martin Kreidl, Zuzana Žilinčíková · 2023 · Demographic Research
Background : Several studies show that cohabiting adult children have less frequent contact with their mothers than married adult children. We argue that these findings might be spurious due to confounding. Objective : Our aim is to replicate earlier research using more robust statistical instruments from the family of multi-level models with fixed effects, which are known to offer better control of omitted-variable bias. We also want to show the extent to which union-type effects vary across countries and by parenthood status. Methods : We use data from the SHARE survey. Mothers are the prima
View details →DOI: 10.4054/demres.2023.48.23