e-ISSN: Pending

Browse the failure-mode index

142 real negative results, null findings, and replication failures in Mathematics · Negative / Null Result Report. Search the index →

WASTE indexes published research — it does not host or republish full papers. Each entry is a metadata record compiled from open scholarly databases; the abstract is shown in full only where the paper is openly licensed, otherwise a short excerpt under fair use. Classifications are automated and approximate.

Negative / Null Result ReportOpen accessMathematics

The harmonic mean p -value for combining dependent tests

Daniel J. Wilson · 2019 · Proceedings of the National Academy of Sciences

-value (HMP), which controls the FWER while greatly improving statistical power by combining dependent tests using generalized central limit theorem. I show that the HMP effortlessly combines information to detect statistically significant signals among groups of individually nonsignificant hypotheses in examples of a human GWAS for neuroticism and a joint human-pathogen GWAS for hepatitis C viral load. The HMP simultaneously tests all ways to group hypotheses, allowing the smallest groups of hypotheses that retain significance to be sought. The power of the HMP to detect significant hypothesi

View details →
Negative / Null Result ReportOpen accessMathematics

Generalizability of heterogeneous treatment effect estimates across samples

Alexander Coppock, Thomas J. Leeper, Kevin Mullinix · 2018 · Proceedings of the National Academy of Sciences

The extent to which survey experiments conducted with nonrepresentative convenience samples are generalizable to target populations depends critically on the degree of treatment effect heterogeneity. Recent inquiries have found a strong…

View details →
Negative / Null Result ReportMathematics

Numerical predictors of arithmetic success in grades 1–6

Ian M. Lyons, Gavin R. Price, Anniek Vaessen et al. · 2014 · Developmental Science

Math relies on mastery and integration of a wide range of simpler numerical processes and concepts. Recent work has identified several numerical competencies that predict variation in math ability. We examined the unique relations between…

View details →
Negative / Null Result ReportOpen accessMathematics

Should multiple imputation be the method of choice for handling missing data in randomized trials?

Thomas Sullivan, Ian R. White, Amy Salter et al. · 2016 · Statistical Methods in Medical Research

The use of multiple imputation has increased markedly in recent years, and journal reviewers may expect to see multiple imputation used to handle missing data. However in randomized trials, where treatment group is always observed and…

View details →
Negative / Null Result ReportOpen accessMathematics

Misuse of DeLong test to compare AUCs for nested models

Olga Demler, Michael Pencina, Ralph B. D’Agostino · 2012 · Statistics in Medicine

The area under the receiver operating characteristics curve (AUC of ROC) is a widely used measure of discrimination in risk prediction models. Routinely, the Mann-Whitney statistics is used as an estimator of AUC, while the change in AUC…

View details →
Negative / Null Result ReportOpen accessMathematics

An Equivalence Approach to Balance and Placebo Tests

Erin Hartman, F. Daniel Hidalgo · 2018 · American Journal of Political Science

Abstract Recent emphasis on credible causal designs has led to the expectation that scholars justify their research designs by testing the plausibility of their causal identification assumptions, often through balance and placebo tests.…

View details →
Negative / Null Result ReportOpen accessMathematics

A cautionary note on the use of the Analysis of Covariance (ANCOVA) in classification designs with and without within-subject factors

Bruce A. Schneider, Meital Avivi-Reich, Mindaugas Mozuraitis · 2015 · Frontiers in Psychology

A number of statistical textbooks recommend using an analysis of covariance (ANCOVA) to control for the effects of extraneous factors that might influence the dependent measure of interest. However, it is not generally recognized that serious problems of interpretation can arise when the design contains comparisons of participants sampled from different populations (classification designs). Designs that include a comparison of younger and older adults, or a comparison of musicians and non-musicians are examples of classification designs. In such cases, estimates of differences among groups can

View details →
Negative / Null Result ReportOpen accessMathematics

Random-Effects, Fixed-Effects and the within-between Specification for Clustered Data in Observational Health Studies: A Simulation Study

Joseph L. Dieleman, Tara Templin · 2014 · PLoS ONE

BACKGROUND: When unaccounted-for group-level characteristics affect an outcome variable, traditional linear regression is inefficient and can be biased. The random- and fixed-effects estimators (RE and FE, respectively) are two competing methods that address these problems. While each estimator controls for otherwise unaccounted-for effects, the two estimators require different assumptions. Health researchers tend to favor RE estimation, while researchers from some other disciplines tend to favor FE estimation. In addition to RE and FE, an alternative method called within-between (WB) was sugg

View details →
Negative / Null Result ReportOpen accessMathematics

Vision senses number directly

John Ross · 2010 · Journal of Vision

We have recently suggested that numerosity is a primary sensory attribute, and shown that it is strongly susceptible to adaptation. Here we use the Method of Single Stimuli to show that observers can extract a running average of numerosity…

View details →
Negative / Null Result ReportOpen accessMathematics

Determining organ weight toxicity with Bayesian causal models: Improving on the analysis of relative organ weights

Stanley E. Lazic, Elizaveta Semenova, Dominic P. Williams · 2020 · Scientific Reports

Regulatory authorities require animal toxicity tests for new chemical entities. Organ weight changes are accepted as a sensitive indicator of chemically induced organ damage, but can be difficult to interpret because changes in organ weight might reflect chemically-induced changes in overall body weight. A common solution is to calculate the relative organ weight (organ to body weight ratio), but this inadequately controls for the dependence on body weight - a point made by statisticians for decades, but which has not been widely adopted. The recommended solution is an analysis of covariance (

View details →
Negative / Null Result ReportOpen accessMathematics

Paired-Samples Tests of Equivalence

Constance A. Mara, Robert A. Cribbie · 2012 · Communications in Statistics - Simulation and Computation

Equivalence tests are used when the objective is to find that two or more groups are nearly equivalent on some outcome, such that any difference is inconsequential. Equivalence tests are available for several research designs, however,…

View details →
Negative / Null Result ReportOpen accessMathematics

Estimating the Power of Indirect Comparisons: A Simulation Study

Edward J. Mills, Isabella Ghement, Christopher O’Regan et al. · 2011 · PLoS ONE

BACKGROUND: Indirect comparisons are becoming increasingly popular for evaluating medical treatments that have not been compared head-to-head in randomized clinical trials (RCTs). While indirect methods have grown in popularity and acceptance, little is known about the fragility of confidence interval estimations and hypothesis testing relying on this method. METHODS: We present the findings of a simulation study that examined the fragility of indirect confidence interval estimation and hypothesis testing relying on the adjusted indirect method. FINDINGS: Our results suggest that, for the sett

View details →
Negative / Null Result ReportOpen accessMathematics

Are Network-Based Interventions a Useful Antiobesity Strategy? An Application of Simulation Models for Causal Inference in Epidemiology

Abdulrahman M. El‐Sayed, Lars Seemann, Peter Scarborough et al. · 2013 · American Journal of Epidemiology

Recent research suggests that social networks may present an avenue for intervention against obesity. By using a simulation model in which artificial individuals were nested in a social network, we assessed whether interventions targeting…

View details →
Negative / Null Result ReportOpen accessMathematics

Registered Replication Report on Fischer, Castel, Dodd, and Pratt (2003)

Lincoln Colling, Dénes Szűcs, Damiano De Marco et al. · 2020 · Advances in Methods and Practices in Psychological Science

The attentional spatial-numerical association of response codes (Att-SNARC) effect (Fischer, Castel, Dodd, & Pratt, 2003)—the finding that participants are quicker to detect left-side targets when the targets are preceded by small numbers and quicker to detect right-side targets when they are preceded by large numbers—has been used as evidence for embodied number representations and to support strong claims about the link between number and space (e.g., a mental number line). We attempted to replicate Experiment 2 of Fischer et al. by collecting data from 1,105 participants at 17 labs. Acr

View details →
Negative / Null Result ReportOpen accessMathematics

Bayesian reanalysis of null results reported in medicine: Strong yet variable evidence for the absence of treatment effects

Rink Hoekstra, Rei Monden, Don van Ravenzwaaij et al. · 2018 · PLoS ONE

Efficient medical progress requires that we know when a treatment effect is absent. We considered all 207 Original Articles published in the 2015 volume of the New England Journal of Medicine and found that 45 (21.7%) reported a null result for at least one of the primary outcome measures. Unfortunately, standard statistical analyses are unable to quantify the degree to which these null results actually support the null hypothesis. Such quantification is possible, however, by conducting a Bayesian hypothesis test. Here we reanalyzed a subset of 43 null results from 36 articles using a default

View details →
Negative / Null Result ReportOpen accessMathematics

Increasing efficiency of preclinical research by group sequential designs

Konrad Neumann, Ulrike Grittner, Sophie K. Piper et al. · 2017 · PLoS Biology

Despite the potential benefits of sequential designs, studies evaluating treatments or experimental manipulations in preclinical experimental biomedicine almost exclusively use classical block designs. Our aim with this article is to bring the existing methodology of group sequential designs to the attention of researchers in the preclinical field and to clearly illustrate its potential utility. Group sequential designs can offer higher efficiency than traditional methods and are increasingly used in clinical trials. Using simulation of data, we demonstrate that group sequential designs have t

View details →
Negative / Null Result ReportMathematics

Can Computer-Assisted Discovery Learning Foster First Graders’ Fluency With the Most Basic Addition Combinations?

Arthur J. Baroody, Michael D. Eiland, David J. Purpura et al. · 2013 · American Educational Research Journal

In a 9-month training experiment, 64 first graders with a risk factor were randomly assigned to computer-assisted structured discovery of the add-1 rule (e.g., the sum of 7 + 1 is the number after “seven” when we count), unstructured…

View details →
Negative / Null Result ReportOpen accessMathematics

Learning data science in elementary school mathematics: a comparative curriculum analysis

Yook Kit Ow-Yeong, Ibrahim H. Yeter, Farhan Ali · 2023 · International Journal of STEM Education

Abstract Background Data literacy is increasingly important in today’s data-driven world. Students across many educational systems first formally learn about data in elementary school not as a separate subject but via the mathematics curriculum. This experience can create tensions in the priorities of learning and assessment given the presence of other foundational mathematics content domains such as numbers, algebra, measurement, and geometry. There is a need to study data literacy in comparison to these other content domains in elementary mathematics. To address this need, we developed a met

View details →
Negative / Null Result ReportOpen accessMathematics

Scaling of contact networks for epidemic spreading in urban transit systems

Xinwu Qian, Lijun Sun, Satish V. Ukkusuri · 2021 · Scientific Reports

Improved mobility not only contributes to more intensive human activities but also facilitates the spread of communicable disease, thus constituting a major threat to billions of urban commuters. In this study, we present a multi-city investigation of communicable diseases percolating among metro travelers. We use smart card data from three megacities in China to construct individual-level contact networks, based on which the spread of disease is modeled and studied. We observe that, though differing in urban forms, network layouts, and mobility patterns, the metro systems of the three cities

View details →
Negative / Null Result ReportOpen accessMathematics

Integrated longitudinal multiomics study identifies immune programs associated with acute COVID-19 severity and mortality

Jeremy P. Gygi, Cole Maguire, Ravi K. Patel et al. · 2024 · Journal of Clinical Investigation

BACKGROUNDPatients hospitalized for COVID-19 exhibit diverse clinical outcomes, with outcomes for some individuals diverging over time even though their initial disease severity appears similar to that of other patients. A systematic evaluation of molecular and cellular profiles over the full disease course can link immune programs and their coordination with progression heterogeneity.METHODSWe performed deep immunophenotyping and conducted longitudinal multiomics modeling, integrating 10 assays for 1,152 Immunophenotyping Assessment in a COVID-19 Cohort (IMPACC) study participants and identif

View details →
Negative / Null Result ReportOpen accessMathematics

BIO-LGCA: A cellular automaton modelling class for analysing collective cell migration

Andreas Deutsch, Josué Manik Nava-Sedeño, Simon Syga et al. · 2021 · PLoS Computational Biology

Collective dynamics in multicellular systems such as biological organs and tissues plays a key role in biological development, regeneration, and pathological conditions. Collective tissue dynamics-understood as population behaviour arising from the interplay of the constituting discrete cells-can be studied with on- and off-lattice agent-based models. However, classical on-lattice agent-based models, also known as cellular automata, fail to replicate key aspects of collective migration, which is a central instance of collective behaviour in multicellular systems. To overcome drawbacks of class

View details →
Negative / Null Result ReportMathematics

Comparison of the Effects of Computer-Based Practice and Conceptual Understanding Interventions on Mathematics Fact Retention and Generalization

Rebecca Kanive, Peter M. Nelson, Matthew K. Burns et al. · 2013 · The Journal of Educational Research

ABSTRACT The authors’ purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A…

View details →
Negative / Null Result ReportOpen accessMathematics

NASCO: A new method and program to generate dot arrays for non-symbolic number comparison tasks

Mathieu Guillaumé, Christine Schiltz, Amandine Van Rinsveld · 2020 · Journal of Numerical Cognition

Basic numerical abilities are generally assumed to influence more complex cognitive processes involving numbers, such as mathematics. Yet measuring non-symbolic number abilities remains challenging due to the intrinsic correlation between numerical and non-numerical dimensions of any visual scene. Several methods have been developed to generate non-symbolic stimuli controlling for the latter aspects but they tend to be difficult to replicate or implement. In this study, we describe the NASCO method, which is an extension to the method popularized by Dehaene, Izard, and Piazza (2005). Their pro

View details →
Negative / Null Result ReportMathematics

Priming Mathematics Word Problem Structures in a Rural Elementary Classroom

Cynthia C. Griffin, Joseph Calvin Gagnon, Maggie H. Jossi et al. · 2018 · Rural Special Education Quarterly

This study examined mathematics strategy instruction that primes the common underlying structures of word problems using explicit instruction in a rural elementary classroom with fourth- and fifth-grade students with and without…

View details →