e-ISSN: Pending

Browse the failure-mode index

60 real negative results, null findings, and replication failures in Decision Sciences. Search the index →

WASTE indexes published research — it does not host or republish full papers. Each entry is a metadata record compiled from open scholarly databases; the abstract is shown in full only where the paper is openly licensed, otherwise a short excerpt under fair use. Classifications are automated and approximate.

Replication FailureOpen accessDecision Sciences

Estimating the reproducibility of psychological science

Alexander A. Aarts · 2015 · Science

Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using…

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results

Jelte M. Wicherts, Marjan Bakker, Dylan Molenaar · 2011 · PLoS ONE

BACKGROUND: The widespread reluctance to share published research data is often hypothesized to be due to the authors' fear that reanalysis may expose errors in their work or may produce conclusions that contradict their own. However, these hypotheses have not previously been studied systematically. METHODS AND FINDINGS: We related the reluctance to share research data for reanalysis to 1148 statistically significant results reported in 49 papers published in two major psychology journals. We found the reluctance to share data to be associated with weaker evidence (against the null hypothesis

View details →
Methods Dead-EndOpen accessDecision Sciences

Comparing multiple comparisons: practical guidance for choosing the best multiple comparisons test

Stephen R. Midway, Matthew Robertson, Shane Flinn et al. · 2020 · PeerJ

Multiple comparisons tests (MCTs) include the statistical tests used to compare groups (treatments) often following a significant effect reported in one of many types of linear models. Due to a variety of data and statistical considerations, several dozen MCTs have been developed over the decades, with tests ranging from very similar to each other to very different from each other. Many scientific disciplines use MCTs, including >40,000 reports of their use in ecological journals in the last 60 years. Despite the ubiquity and utility of MCTs, several issues remain in terms of their correct

View details →
Replication FailureOpen accessDecision Sciences

Inferential Statistics as Descriptive Statistics: There Is No Replication Crisis if We Don’t Expect Replication

Valentin Amrhein, David Trafimow, Sander Greenland · 2019 · The American Statistician

Statistical inference often fails to replicate. One reason is that many results may be selected for drawing inference because some threshold of a statistic like the P-value was crossed, leading to biased reported effect sizes. Nonetheless,…

View details →
Negative / Null Result ReportOpen accessDecision Sciences

MOBILE BANKING ADOPTION: APPLICATION OF DIFFUSION OF INNOVATION THEORY

Ibrahim M. Al‐Jabri, M. Sadiq Sohail · 2012 · SSRN Electronic Journal

Many banks in Saudi Arabia are starting to offer banking services through mobile phones. However, not many studies investigate the factors that may help the bankers to design mobile services, which are suitable for and adoptable by bank…

View details →
Negative / Null Result ReportDecision Sciences

Enjoyment and social influence: predicting mobile payment adoption

Nicole Koenig‐Lewis, Morgan Marquet, Adrian Palmer et al. · 2015 · Service Industries Journal

Models of technology adoption, notably the Technology Acceptance Model and the Unified Theories of Acceptance and Use of Technology, provide good theoretical foundations for understanding mobile payment adoption. This study extends these…

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Likelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time

Robert M. Kaplan, Veronica L. Irvin · 2015 · PLoS ONE

BACKGROUND: We explore whether the number of null results in large National Heart Lung, and Blood Institute (NHLBI) funded trials has increased over time. METHODS: We identified all large NHLBI supported RCTs between 1970 and 2012 evaluating drugs or dietary supplements for the treatment or prevention of cardiovascular disease. Trials were included if direct costs >$500,000/year, participants were adult humans, and the primary outcome was cardiovascular risk, disease or death. The 55 trials meeting these criteria were coded for whether they were published prior to or after the year 2000, wheth

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Students’ Acceptance of ChatGPT in Higher Education: An Extended Unified Theory of Acceptance and Use of Technology

Artur Strzelecki · 2023 · Innovative Higher Education

Abstract AI-powered chat technology is an emerging topic worldwide, particularly in areas such as education, research, writing, publishing, and authorship. This study aims to explore the factors driving students' acceptance of ChatGPT in higher education. The study employs the unified theory of acceptance and use of technology (UTAUT2) theoretical model, with an extension of Personal innovativeness, to verify the Behavioral intention and Use behavior of ChatGPT by students. The study uses data from a sample of 503 Polish state university students. The PLS-SEM method is utilized to test the mod

View details →
Replication FailureOpen accessDecision Sciences

Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition

Tom E Hardwicke, Maya B. Mathur, Kyle MacDonald et al. · 2018 · Royal Society Open Science

Access to data is a critical feature of an efficient, progressive and ultimately self-correcting scientific ecosystem. But the extent to which in-principle benefits of data sharing are realized in practice is unclear. Crucially, it is largely unknown whether published findings can be reproduced by repeating reported analyses upon shared data (‘analytic reproducibility’). To investigate this, we conducted an observational evaluation of a mandatory open data policy introduced at the journal Cognition . Interrupted time-series analyses indicated a substantial post-policy increase in data availabl

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Questionable research practices in ecology and evolution

Hannah Fraser, Timothy Parker, Shinichi Nakagawa et al. · 2018 · PLoS ONE

We surveyed 807 researchers (494 ecologists and 313 evolutionary biologists) about their use of Questionable Research Practices (QRPs), including cherry picking statistically significant results, p hacking, and hypothesising after the results are known (HARKing). We also asked them to estimate the proportion of their colleagues that use each of these QRPs. Several of the QRPs were prevalent within the ecology and evolution research community. Across the two groups, we found 64% of surveyed researchers reported they had at least once failed to report results because they were not statistically

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Like ripples on a pond: Behavioral spillovers and their implications for research and policy

Paul Dolan, Matteo M. Galizzi · 2015 · Journal of Economic Psychology

No behavior sits in a vacuum, and one behavior can greatly affect what happens next. We propose a conceptual frame within which a broad range of behavioral spillovers can be accounted for when applying behavioral science to policy challenges. We consider behaviors which take place sequentially and are linked, at a conscious or unconscious level, by some underlying motive. The first behavior leads to another behavior which can either work in the same direction as the first (promoting spillover), or push back against it (permitting or purging spillover). Looking through this conceptual lens at t

View details →
Negative / Null Result ReportDecision Sciences

Would you like to shop via mobile app technology? The technology acceptance model, social factors and purchase intention

Arash Vahdat, Ali Alizadeh, Sara Quach et al. · 2020 · Australasian Marketing Journal (AMJ)

This study investigates how technology acceptance model (TAM) factors and social factors determine customer purchase intention. Although previous studies on mobile apps have investigated TAM, critical social factors have been neglected,…

View details →
Negative / Null Result ReportDecision Sciences

Quantifying Performance for the Integrated Project Delivery System as Compared to Established Delivery Systems

Mounir El Asmar, Awad S. Hanna, Wei‐Yin Loh · 2013 · Journal of Construction Engineering and Management

Integrated project delivery (IPD) is an emerging construction project delivery system that collaboratively involves key participants very early in the project timeline, often before the design is started. It is distinguished by a…

View details →
Negative / Null Result ReportDecision Sciences

An empirical examination of customers’ adoption of m-banking in India

Madhurima Deb, Ewuuk Lomo‐David · 2014 · Marketing Intelligence & Planning

Purpose – The purpose of this paper is to identify factors impacting the adoption of m-banking. Design/methodology/approach – To attain the above objective a conceptual model was developed based on Technology Acceptance Model (TAM) and…

View details →
Replication FailureOpen accessDecision Sciences

Nonreplicable publications are cited more than replicable ones

Marta Serra-García, Uri Gneezy · 2021 · Science Advances

We use publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the…

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Power and Error: Increased Risk of False Positive Results in Underpowered Studies

Robert Christley · 2010 · The Open Epidemiology Journal

It is well recognised that low statistical power increases the probability of type II error, that is it reduces the probability of detecting a difference between groups, where a difference exists. Paradoxically, low statistical power also increases the likelihood that a statistically significant finding is actually falsely positive (for a given p-value). Hence, ethical concerns regarding studies with low statistical power should include the increased risk of type I error in such studies reporting statistically significant effects. This paper illustrates the effect of low statistical power by c

View details →
Negative / Null Result ReportDecision Sciences

The Fragility of Statistically Significant Findings From Randomized Trials in Sports Surgery: A Systematic Survey

Moin Khan, Nathan Evaniew, Mark Gichuru et al. · 2016 · The American Journal of Sports Medicine

BACKGROUND: High-quality, evidence-based orthopaedic care relies on the generation and translation of robust research evidence. The Fragility Index is a novel method for evaluating the robustness of statistically significant findings from…

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Quantifying the impact of weak, strong, and super ties in scientific careers

Alexander M. Petersen · 2015 · Proceedings of the National Academy of Sciences

Scientists are frequently faced with the important decision to start or terminate a creative partnership. This process can be influenced by strategic motivations, as early career researchers are pursuers, whereas senior researchers are…

View details →
Negative / Null Result ReportDecision Sciences

Email Duration, Batching and Self-interruption

Gloria Mark, Shamsi T. Iqbal, Mary Czerwinski et al. · 2016

While email provides numerous benefits in the workplace, it is unclear how patterns of email use might affect key workplace indicators of productivity and stress. We investigate how three email use patterns: duration, interruption habit,…

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Factors influencing purchase intention towards consumer-to-consumer e-commerce

M. Dachyar, Liska Banjarnahor · 2017 · Intangible Capital

Purpose: This study explores factors that influence consumer’s purchase intention at three consumer-to-consumer (C2C) e-commerce companies in Indonesia.Design/methodology/approach: 5 Expert opinions are used to determine the indicators of each factor and the Structural Equation Modelling (SEM) method is used to analyze the empirical data of 400 respondents for each company.Findings: It is found different significant factors that influence customer’s purchase intention in each company. Trust and risk are found to be significantly effect purchase intention in Company A. Meanwhile, the other two

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Acceptance analysis of NUADU as e-learning platform using the Technology Acceptance Model (TAM) approach

Sri Rahayu Natasia, Yuyun Tri Wiranti, Anggi Parastika · 2022 · Procedia Computer Science

The sudden change in the learning process during the Covid-19 pandemic has brought schools at all levels to adopt e-learning. In this study, we analyze user acceptance of NUADU platform in private schools in Balikpapan, Indonesia. The…

View details →
Replication FailureOpen accessDecision Sciences

Analysis of Open Data and Computational Reproducibility in Registered Reports in Psychology

Pepijn Obels, Daniël Lakens, Nicholas A. Coles et al. · 2020 · Advances in Methods and Practices in Psychological Science

Ongoing technological developments have made it easier than ever before for scientists to share their data, materials, and analysis code. Sharing data and analysis code makes it easier for other researchers to reuse or check published research. However, these benefits will emerge only if researchers can reproduce the analyses reported in published articles and if data are annotated well enough so that it is clear what all variable and value labels mean. Because most researchers are not trained in computational reproducibility, it is important to evaluate current practices to identify those tha

View details →
Negative / Null Result ReportOpen accessDecision Sciences

The Effects of Effective Communication on Organizational Performance Based on the Systems Theory

Mukelabai M. Musheke, Jackson Phiri · 2021 · Open Journal of Business and Management

Communication is a very crucial and significant element in an organization, and it is necessary for creating collaboration within the work environment that has effects on organizational performance and decision making. This study on effects of effective communications on organizational performance using the systems theory is thus essential. The objectives of this study were to firstly identify the factors affecting effective communication based on the systems theory and secondly to devise a communication model that addresses these factors to improve organisational performance. A quantitative a

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Belief updating: does the ‘good-news, bad-news’ asymmetry extend to purely financial domains?

Kai Barron · 2020 · Experimental Economics

Abstract Bayes’ statistical rule remains the status quo for modeling belief updating in both normative and descriptive models of behavior under uncertainty. Some recent research has questioned the use of Bayes’ rule in descriptive models of behavior, presenting evidence that people overweight ‘good news’ relative to ‘bad news’ when updating ego-relevant beliefs. In this paper, we present experimental evidence testing whether this ‘good-news, bad-news’ effect is present in a financial decision making context (i.e. a domain that is important for understanding much economic decision making). We f

View details →
Replication FailureDecision Sciences

Revisiting the factor structure of the system usability scale

James R. Lewis, Jeff Sauro · 2017 · Journal of Usability Studies archive

In 2009, we published a paper in which we showed how three independent sources of data indicated that, rather than being a unidimensional measure of perceived usability, the System Usability Scale apparently had two factors: Usability (all…

View details →
Negative / Null Result ReportOpen accessDecision Sciences

Publication Bias in Antipsychotic Trials: An Analysis of Efficacy Comparing the Published Literature to the US Food and Drug Administration Database

Erick H. Turner, Daniel Knoepflmacher, Lee Shapley · 2012 · PLoS Medicine

BACKGROUND: Publication bias compromises the validity of evidence-based medicine, yet a growing body of research shows that this problem is widespread. Efficacy data from drug regulatory agencies, e.g., the US Food and Drug Administration (FDA), can serve as a benchmark or control against which data in journal articles can be checked. Thus one may determine whether publication bias is present and quantify the extent to which it inflates apparent drug efficacy. METHODS AND FINDINGS: FDA Drug Approval Packages for eight second-generation antipsychotics-aripiprazole, iloperidone, olanzapine, pali

View details →