155 real negative results, null findings, and replication failures in Mathematics. Search the index →
WASTE indexes published research — it does not host or republish full papers. Each entry is a metadata record compiled from open scholarly databases; the abstract is shown in full only where the paper is openly licensed, otherwise a short excerpt under fair use. Classifications are automated and approximate.
Alwyn Young · 2018 · The Quarterly Journal of Economics
I follow R. A. Fisher's The Design of Experiments (1935), using randomization statistical inference to test the null hypothesis of no treatment effects in a comprehensive sample of 53 experimental papers drawn from the journals of the…
View details →Daniel J. Wilson · 2019 · Proceedings of the National Academy of Sciences
-value (HMP), which controls the FWER while greatly improving statistical power by combining dependent tests using generalized central limit theorem. I show that the HMP effortlessly combines information to detect statistically significant signals among groups of individually nonsignificant hypotheses in examples of a human GWAS for neuroticism and a joint human-pathogen GWAS for hepatitis C viral load. The HMP simultaneously tests all ways to group hypotheses, allowing the smallest groups of hypotheses that retain significance to be sought. The power of the HMP to detect significant hypothesi
View details →Alexander Coppock, Thomas J. Leeper, Kevin Mullinix · 2018 · Proceedings of the National Academy of Sciences
The extent to which survey experiments conducted with nonrepresentative convenience samples are generalizable to target populations depends critically on the degree of treatment effect heterogeneity. Recent inquiries have found a strong…
View details →Ian M. Lyons, Gavin R. Price, Anniek Vaessen et al. · 2014 · Developmental Science
Math relies on mastery and integration of a wide range of simpler numerical processes and concepts. Recent work has identified several numerical competencies that predict variation in math ability. We examined the unique relations between…
View details →Abel Brodeur, Nikolai Cook, Anthony Heyes · 2020 · American Economic Review
The credibility revolution in economics has promoted causal identification using randomized control trials (RCT), difference-in-differences (DID), instrumental variables (IV) and regression discontinuity design (RDD). Applying multiple…
View details →Thomas Sullivan, Ian R. White, Amy Salter et al. · 2016 · Statistical Methods in Medical Research
The use of multiple imputation has increased markedly in recent years, and journal reviewers may expect to see multiple imputation used to handle missing data. However in randomized trials, where treatment group is always observed and…
View details →Olga Demler, Michael Pencina, Ralph B. D’Agostino · 2012 · Statistics in Medicine
The area under the receiver operating characteristics curve (AUC of ROC) is a widely used measure of discrimination in risk prediction models. Routinely, the Mann-Whitney statistics is used as an estimator of AUC, while the change in AUC…
View details →Erin Hartman, F. Daniel Hidalgo · 2018 · American Journal of Political Science
Abstract Recent emphasis on credible causal designs has led to the expectation that scholars justify their research designs by testing the plausibility of their causal identification assumptions, often through balance and placebo tests.…
View details →Joseph L. Dieleman, Tara Templin · 2014 · PLoS ONE
BACKGROUND: When unaccounted-for group-level characteristics affect an outcome variable, traditional linear regression is inefficient and can be biased. The random- and fixed-effects estimators (RE and FE, respectively) are two competing methods that address these problems. While each estimator controls for otherwise unaccounted-for effects, the two estimators require different assumptions. Health researchers tend to favor RE estimation, while researchers from some other disciplines tend to favor FE estimation. In addition to RE and FE, an alternative method called within-between (WB) was sugg
View details →Bruce A. Schneider, Meital Avivi-Reich, Mindaugas Mozuraitis · 2015 · Frontiers in Psychology
A number of statistical textbooks recommend using an analysis of covariance (ANCOVA) to control for the effects of extraneous factors that might influence the dependent measure of interest. However, it is not generally recognized that serious problems of interpretation can arise when the design contains comparisons of participants sampled from different populations (classification designs). Designs that include a comparison of younger and older adults, or a comparison of musicians and non-musicians are examples of classification designs. In such cases, estimates of differences among groups can
View details →Kyle Peyton, Gregory A. Huber, Alexander Coppock · 2021 · Journal of Experimental Political Science
Abstract The COVID-19 pandemic imposed new constraints on empirical research, and online data collection by social scientists increased. Generalizing from experiments conducted during this period of persistent crisis may be challenging due…
View details →John Ross · 2010 · Journal of Vision
We have recently suggested that numerosity is a primary sensory attribute, and shown that it is strongly susceptible to adaptation. Here we use the Method of Single Stimuli to show that observers can extract a running average of numerosity…
View details →Alexander Pate, Richard D Riley, Gary S. Collins et al. · 2023 · Statistical Methods in Medical Research
Aims Multinomial logistic regression models allow one to predict the risk of a categorical outcome with > 2 categories. When developing such a model, researchers should ensure the number of participants ([Formula: see text]) is appropriate relative to the number of events ([Formula: see text]) and the number of predictor parameters ([Formula: see text]) for each category k. We propose three criteria to determine the minimum n required in light of existing criteria developed for binary outcomes. Proposed criteria The first criterion aims to minimise the model overfitting. The second aims to
View details →Valentijn M. T. de Jong, Marinus J.C. Eijkemans, Ben Van Calster et al. · 2019 · Statistics in Medicine
Multinomial Logistic Regression (MLR) has been advocated for developing clinical prediction models that distinguish between three or more unordered outcomes. We present a full-factorial simulation study to examine the predictive…
View details →Amelia Averitt, Chunhua Weng, Patrick Ryan et al. · 2020 · npj Digital Medicine
Randomized controlled trials (RCTs) are regarded as the most reputable source of evidence. In some studies, factors beyond the intervention itself may contribute to the measured effect, an occurrence known as heterogeneity of treatment effect (HTE). If the RCT population differs from the real-world population on factors that induce HTE, the trials effect will not replicate. The RCTs eligibility criteria should identify the sub-population in which its evidence will replicate. However, the extent to which the eligibility criteria identify the appropriate population is unknown, which raises conce
View details →Stanley E. Lazic, Elizaveta Semenova, Dominic P. Williams · 2020 · Scientific Reports
Regulatory authorities require animal toxicity tests for new chemical entities. Organ weight changes are accepted as a sensitive indicator of chemically induced organ damage, but can be difficult to interpret because changes in organ weight might reflect chemically-induced changes in overall body weight. A common solution is to calculate the relative organ weight (organ to body weight ratio), but this inadequately controls for the dependence on body weight - a point made by statisticians for decades, but which has not been widely adopted. The recommended solution is an analysis of covariance (
View details →Constance A. Mara, Robert A. Cribbie · 2012 · Communications in Statistics - Simulation and Computation
Equivalence tests are used when the objective is to find that two or more groups are nearly equivalent on some outcome, such that any difference is inconsequential. Equivalence tests are available for several research designs, however,…
View details →Edward J. Mills, Isabella Ghement, Christopher O’Regan et al. · 2011 · PLoS ONE
BACKGROUND: Indirect comparisons are becoming increasingly popular for evaluating medical treatments that have not been compared head-to-head in randomized clinical trials (RCTs). While indirect methods have grown in popularity and acceptance, little is known about the fragility of confidence interval estimations and hypothesis testing relying on this method. METHODS: We present the findings of a simulation study that examined the fragility of indirect confidence interval estimation and hypothesis testing relying on the adjusted indirect method. FINDINGS: Our results suggest that, for the sett
View details →Abdulrahman M. El‐Sayed, Lars Seemann, Peter Scarborough et al. · 2013 · American Journal of Epidemiology
Recent research suggests that social networks may present an avenue for intervention against obesity. By using a simulation model in which artificial individuals were nested in a social network, we assessed whether interventions targeting…
View details →Lincoln Colling, Dénes Szűcs, Damiano De Marco et al. · 2020 · Advances in Methods and Practices in Psychological Science
The attentional spatial-numerical association of response codes (Att-SNARC) effect (Fischer, Castel, Dodd, & Pratt, 2003)—the finding that participants are quicker to detect left-side targets when the targets are preceded by small numbers and quicker to detect right-side targets when they are preceded by large numbers—has been used as evidence for embodied number representations and to support strong claims about the link between number and space (e.g., a mental number line). We attempted to replicate Experiment 2 of Fischer et al. by collecting data from 1,105 participants at 17 labs. Acr
View details →Rink Hoekstra, Rei Monden, Don van Ravenzwaaij et al. · 2018 · PLoS ONE
Efficient medical progress requires that we know when a treatment effect is absent. We considered all 207 Original Articles published in the 2015 volume of the New England Journal of Medicine and found that 45 (21.7%) reported a null result for at least one of the primary outcome measures. Unfortunately, standard statistical analyses are unable to quantify the degree to which these null results actually support the null hypothesis. Such quantification is possible, however, by conducting a Bayesian hypothesis test. Here we reanalyzed a subset of 43 null results from 36 articles using a default
View details →Konrad Neumann, Ulrike Grittner, Sophie K. Piper et al. · 2017 · PLoS Biology
Despite the potential benefits of sequential designs, studies evaluating treatments or experimental manipulations in preclinical experimental biomedicine almost exclusively use classical block designs. Our aim with this article is to bring the existing methodology of group sequential designs to the attention of researchers in the preclinical field and to clearly illustrate its potential utility. Group sequential designs can offer higher efficiency than traditional methods and are increasingly used in clinical trials. Using simulation of data, we demonstrate that group sequential designs have t
View details →W. Trey Hill, Gary L. Brase · 2012 · Quarterly Journal of Experimental Psychology
The thesis that the mind is better prepared to process frequencies-as compared to other numerical formats-continues to be debated. A recent aspect of this issue is the role of numeracy (numerical literacy; one's ability to understand and…
View details →Arthur J. Baroody, Michael D. Eiland, David J. Purpura et al. · 2013 · American Educational Research Journal
In a 9-month training experiment, 64 first graders with a risk factor were randomly assigned to computer-assisted structured discovery of the add-1 rule (e.g., the sum of 7 + 1 is the number after “seven” when we count), unstructured…
View details →Yook Kit Ow-Yeong, Ibrahim H. Yeter, Farhan Ali · 2023 · International Journal of STEM Education
Abstract Background Data literacy is increasingly important in today’s data-driven world. Students across many educational systems first formally learn about data in elementary school not as a separate subject but via the mathematics curriculum. This experience can create tensions in the priorities of learning and assessment given the presence of other foundational mathematics content domains such as numbers, algebra, measurement, and geometry. There is a need to study data literacy in comparison to these other content domains in elementary mathematics. To address this need, we developed a met
View details →Xinwu Qian, Lijun Sun, Satish V. Ukkusuri · 2021 · Scientific Reports
Improved mobility not only contributes to more intensive human activities but also facilitates the spread of communicable disease, thus constituting a major threat to billions of urban commuters. In this study, we present a multi-city investigation of communicable diseases percolating among metro travelers. We use smart card data from three megacities in China to construct individual-level contact networks, based on which the spread of disease is modeled and studied. We observe that, though differing in urban forms, network layouts, and mobility patterns, the metro systems of the three cities
View details →Jeremy P. Gygi, Cole Maguire, Ravi K. Patel et al. · 2024 · Journal of Clinical Investigation
BACKGROUNDPatients hospitalized for COVID-19 exhibit diverse clinical outcomes, with outcomes for some individuals diverging over time even though their initial disease severity appears similar to that of other patients. A systematic evaluation of molecular and cellular profiles over the full disease course can link immune programs and their coordination with progression heterogeneity.METHODSWe performed deep immunophenotyping and conducted longitudinal multiomics modeling, integrating 10 assays for 1,152 Immunophenotyping Assessment in a COVID-19 Cohort (IMPACC) study participants and identif
View details →Andreas Deutsch, Josué Manik Nava-Sedeño, Simon Syga et al. · 2021 · PLoS Computational Biology
Collective dynamics in multicellular systems such as biological organs and tissues plays a key role in biological development, regeneration, and pathological conditions. Collective tissue dynamics-understood as population behaviour arising from the interplay of the constituting discrete cells-can be studied with on- and off-lattice agent-based models. However, classical on-lattice agent-based models, also known as cellular automata, fail to replicate key aspects of collective migration, which is a central instance of collective behaviour in multicellular systems. To overcome drawbacks of class
View details →Rebecca Kanive, Peter M. Nelson, Matthew K. Burns et al. · 2013 · The Journal of Educational Research
ABSTRACT The authors’ purpose was to determine the effects of computer-based practice and conceptual interventions on computational fluency and word-problem solving of fourth- and fifth-grade students with mathematics difficulties. A…
View details →Mathieu Guillaumé, Christine Schiltz, Amandine Van Rinsveld · 2020 · Journal of Numerical Cognition
Basic numerical abilities are generally assumed to influence more complex cognitive processes involving numbers, such as mathematics. Yet measuring non-symbolic number abilities remains challenging due to the intrinsic correlation between numerical and non-numerical dimensions of any visual scene. Several methods have been developed to generate non-symbolic stimuli controlling for the latter aspects but they tend to be difficult to replicate or implement. In this study, we describe the NASCO method, which is an extension to the method popularized by Dehaene, Izard, and Piazza (2005). Their pro
View details →