Replication FailureOpen accessDecision Sciences
Alexander A. Aarts · 2015 · Science
Reproducibility is a defining feature of science, but the extent to which it characterizes current research is unknown. We conducted replications of 100 experimental and correlational studies published in three psychology journals using…
View details →Negative / Null Result ReportOpen accessDecision Sciences
Jelte M. Wicherts, Marjan Bakker, Dylan Molenaar · 2011 · PLoS ONE
BACKGROUND: The widespread reluctance to share published research data is often hypothesized to be due to the authors' fear that reanalysis may expose errors in their work or may produce conclusions that contradict their own. However, these hypotheses have not previously been studied systematically. METHODS AND FINDINGS: We related the reluctance to share research data for reanalysis to 1148 statistically significant results reported in 49 papers published in two major psychology journals. We found the reluctance to share data to be associated with weaker evidence (against the null hypothesis
View details →Methods Dead-EndOpen accessDecision Sciences
Stephen R. Midway, Matthew Robertson, Shane Flinn et al. · 2020 · PeerJ
Multiple comparisons tests (MCTs) include the statistical tests used to compare groups (treatments) often following a significant effect reported in one of many types of linear models. Due to a variety of data and statistical considerations, several dozen MCTs have been developed over the decades, with tests ranging from very similar to each other to very different from each other. Many scientific disciplines use MCTs, including >40,000 reports of their use in ecological journals in the last 60 years. Despite the ubiquity and utility of MCTs, several issues remain in terms of their correct
View details →Replication FailureOpen accessDecision Sciences
Valentin Amrhein, David Trafimow, Sander Greenland · 2019 · The American Statistician
Statistical inference often fails to replicate. One reason is that many results may be selected for drawing inference because some threshold of a statistic like the P-value was crossed, leading to biased reported effect sizes. Nonetheless,…
View details →Negative / Null Result ReportOpen accessDecision Sciences
Ibrahim M. Al‐Jabri, M. Sadiq Sohail · 2012 · SSRN Electronic Journal
Many banks in Saudi Arabia are starting to offer banking services through mobile phones. However, not many studies investigate the factors that may help the bankers to design mobile services, which are suitable for and adoptable by bank…
View details →Negative / Null Result ReportDecision Sciences
Nicole Koenig‐Lewis, Morgan Marquet, Adrian Palmer et al. · 2015 · Service Industries Journal
Models of technology adoption, notably the Technology Acceptance Model and the Unified Theories of Acceptance and Use of Technology, provide good theoretical foundations for understanding mobile payment adoption. This study extends these…
View details →Negative / Null Result ReportOpen accessDecision Sciences
Robert M. Kaplan, Veronica L. Irvin · 2015 · PLoS ONE
BACKGROUND: We explore whether the number of null results in large National Heart Lung, and Blood Institute (NHLBI) funded trials has increased over time. METHODS: We identified all large NHLBI supported RCTs between 1970 and 2012 evaluating drugs or dietary supplements for the treatment or prevention of cardiovascular disease. Trials were included if direct costs >$500,000/year, participants were adult humans, and the primary outcome was cardiovascular risk, disease or death. The 55 trials meeting these criteria were coded for whether they were published prior to or after the year 2000, wheth
View details →Negative / Null Result ReportOpen accessDecision Sciences
Artur Strzelecki · 2023 · Innovative Higher Education
Abstract AI-powered chat technology is an emerging topic worldwide, particularly in areas such as education, research, writing, publishing, and authorship. This study aims to explore the factors driving students' acceptance of ChatGPT in higher education. The study employs the unified theory of acceptance and use of technology (UTAUT2) theoretical model, with an extension of Personal innovativeness, to verify the Behavioral intention and Use behavior of ChatGPT by students. The study uses data from a sample of 503 Polish state university students. The PLS-SEM method is utilized to test the mod
View details →Replication FailureOpen accessDecision Sciences
Tom E Hardwicke, Maya B. Mathur, Kyle MacDonald et al. · 2018 · Royal Society Open Science
Access to data is a critical feature of an efficient, progressive and ultimately self-correcting scientific ecosystem. But the extent to which in-principle benefits of data sharing are realized in practice is unclear. Crucially, it is largely unknown whether published findings can be reproduced by repeating reported analyses upon shared data (‘analytic reproducibility’). To investigate this, we conducted an observational evaluation of a mandatory open data policy introduced at the journal Cognition . Interrupted time-series analyses indicated a substantial post-policy increase in data availabl
View details →Negative / Null Result ReportOpen accessDecision Sciences
Hannah Fraser, Timothy Parker, Shinichi Nakagawa et al. · 2018 · PLoS ONE
We surveyed 807 researchers (494 ecologists and 313 evolutionary biologists) about their use of Questionable Research Practices (QRPs), including cherry picking statistically significant results, p hacking, and hypothesising after the results are known (HARKing). We also asked them to estimate the proportion of their colleagues that use each of these QRPs. Several of the QRPs were prevalent within the ecology and evolution research community. Across the two groups, we found 64% of surveyed researchers reported they had at least once failed to report results because they were not statistically
View details →Negative / Null Result ReportOpen accessDecision Sciences
Paul Dolan, Matteo M. Galizzi · 2015 · Journal of Economic Psychology
No behavior sits in a vacuum, and one behavior can greatly affect what happens next. We propose a conceptual frame within which a broad range of behavioral spillovers can be accounted for when applying behavioral science to policy challenges. We consider behaviors which take place sequentially and are linked, at a conscious or unconscious level, by some underlying motive. The first behavior leads to another behavior which can either work in the same direction as the first (promoting spillover), or push back against it (permitting or purging spillover). Looking through this conceptual lens at t
View details →Negative / Null Result ReportDecision Sciences
Peng Chen, Yeong Gug Kim · 2014 · Journal of Internet Commerce
This study uses the Stimuli-Organism-Response framework to examine how consumers’ reasons for shopping and website stimuli affect their attitudes toward online shopping, their ability to regulate their emotional purchases, and their…
View details →Negative / Null Result ReportDecision Sciences
Arash Vahdat, Ali Alizadeh, Sara Quach et al. · 2020 · Australasian Marketing Journal (AMJ)
This study investigates how technology acceptance model (TAM) factors and social factors determine customer purchase intention. Although previous studies on mobile apps have investigated TAM, critical social factors have been neglected,…
View details →Negative / Null Result ReportDecision Sciences
Mounir El Asmar, Awad S. Hanna, Wei‐Yin Loh · 2013 · Journal of Construction Engineering and Management
Integrated project delivery (IPD) is an emerging construction project delivery system that collaboratively involves key participants very early in the project timeline, often before the design is started. It is distinguished by a…
View details →Negative / Null Result ReportDecision Sciences
Ning Zhang, Yongrok Choi · 2013 · The Social Science Journal
This paper proposes two environmental energy efficiency indices, the pure energy efficiency and scale efficiency based on the slacks-based measure of efficiency in data envelopment analysis (SBM-DEA). These two indices are used to measure…
View details →Negative / Null Result ReportDecision Sciences
Christine Kaufmann, Martin Weber, Emily Haisley · 2012 · Management Science
Financial professionals have a great deal of discretion concerning how to relay information about the risk of financial products to their clients. This paper introduces a new risk tool to communicate the risk of investment products, and it…
View details →Negative / Null Result ReportDecision Sciences
Madhurima Deb, Ewuuk Lomo‐David · 2014 · Marketing Intelligence & Planning
Purpose – The purpose of this paper is to identify factors impacting the adoption of m-banking. Design/methodology/approach – To attain the above objective a conceptual model was developed based on Technology Acceptance Model (TAM) and…
View details →Negative / Null Result ReportOpen accessDecision Sciences
Fengyu Song, Tengbin Xiong, Sheetal Parekh‐Bhurke et al. · 2011 · BMJ
OBJECTIVE: To investigate the agreement between direct and indirect comparisons of competing healthcare interventions. DESIGN: Meta-epidemiological study based on sample of meta-analyses of randomised controlled trials. Data sources…
View details →Replication FailureOpen accessDecision Sciences
Marta Serra-García, Uri Gneezy · 2021 · Science Advances
We use publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the…
View details →Negative / Null Result ReportOpen accessDecision Sciences
Robert Christley · 2010 · The Open Epidemiology Journal
It is well recognised that low statistical power increases the probability of type II error, that is it reduces the probability of detecting a difference between groups, where a difference exists. Paradoxically, low statistical power also increases the likelihood that a statistically significant finding is actually falsely positive (for a given p-value). Hence, ethical concerns regarding studies with low statistical power should include the increased risk of type I error in such studies reporting statistically significant effects. This paper illustrates the effect of low statistical power by c
View details →Negative / Null Result ReportDecision Sciences
Moin Khan, Nathan Evaniew, Mark Gichuru et al. · 2016 · The American Journal of Sports Medicine
BACKGROUND: High-quality, evidence-based orthopaedic care relies on the generation and translation of robust research evidence. The Fragility Index is a novel method for evaluating the robustness of statistically significant findings from…
View details →Negative / Null Result ReportOpen accessDecision Sciences
Alexander M. Petersen · 2015 · Proceedings of the National Academy of Sciences
Scientists are frequently faced with the important decision to start or terminate a creative partnership. This process can be influenced by strategic motivations, as early career researchers are pursuers, whereas senior researchers are…
View details →Negative / Null Result ReportDecision Sciences
Gloria Mark, Shamsi T. Iqbal, Mary Czerwinski et al. · 2016
While email provides numerous benefits in the workplace, it is unclear how patterns of email use might affect key workplace indicators of productivity and stress. We investigate how three email use patterns: duration, interruption habit,…
View details →Negative / Null Result ReportOpen accessDecision Sciences
M. Dachyar, Liska Banjarnahor · 2017 · Intangible Capital
Purpose: This study explores factors that influence consumer’s purchase intention at three consumer-to-consumer (C2C) e-commerce companies in Indonesia.Design/methodology/approach: 5 Expert opinions are used to determine the indicators of each factor and the Structural Equation Modelling (SEM) method is used to analyze the empirical data of 400 respondents for each company.Findings: It is found different significant factors that influence customer’s purchase intention in each company. Trust and risk are found to be significantly effect purchase intention in Company A. Meanwhile, the other two
View details →Negative / Null Result ReportOpen accessDecision Sciences
Sri Rahayu Natasia, Yuyun Tri Wiranti, Anggi Parastika · 2022 · Procedia Computer Science
The sudden change in the learning process during the Covid-19 pandemic has brought schools at all levels to adopt e-learning. In this study, we analyze user acceptance of NUADU platform in private schools in Balikpapan, Indonesia. The…
View details →Replication FailureOpen accessDecision Sciences
Pepijn Obels, Daniël Lakens, Nicholas A. Coles et al. · 2020 · Advances in Methods and Practices in Psychological Science
Ongoing technological developments have made it easier than ever before for scientists to share their data, materials, and analysis code. Sharing data and analysis code makes it easier for other researchers to reuse or check published research. However, these benefits will emerge only if researchers can reproduce the analyses reported in published articles and if data are annotated well enough so that it is clear what all variable and value labels mean. Because most researchers are not trained in computational reproducibility, it is important to evaluate current practices to identify those tha
View details →Negative / Null Result ReportOpen accessDecision Sciences
Mukelabai M. Musheke, Jackson Phiri · 2021 · Open Journal of Business and Management
Communication is a very crucial and significant element in an organization, and it is necessary for creating collaboration within the work environment that has effects on organizational performance and decision making. This study on effects of effective communications on organizational performance using the systems theory is thus essential. The objectives of this study were to firstly identify the factors affecting effective communication based on the systems theory and secondly to devise a communication model that addresses these factors to improve organisational performance. A quantitative a
View details →Negative / Null Result ReportOpen accessDecision Sciences
Kai Barron · 2020 · Experimental Economics
Abstract Bayes’ statistical rule remains the status quo for modeling belief updating in both normative and descriptive models of behavior under uncertainty. Some recent research has questioned the use of Bayes’ rule in descriptive models of behavior, presenting evidence that people overweight ‘good news’ relative to ‘bad news’ when updating ego-relevant beliefs. In this paper, we present experimental evidence testing whether this ‘good-news, bad-news’ effect is present in a financial decision making context (i.e. a domain that is important for understanding much economic decision making). We f
View details →Replication FailureDecision Sciences
James R. Lewis, Jeff Sauro · 2017 · Journal of Usability Studies archive
In 2009, we published a paper in which we showed how three independent sources of data indicated that, rather than being a unidimensional measure of perceived usability, the System Usability Scale apparently had two factors: Usability (all…
View details →Negative / Null Result ReportOpen accessDecision Sciences
Erick H. Turner, Daniel Knoepflmacher, Lee Shapley · 2012 · PLoS Medicine
BACKGROUND: Publication bias compromises the validity of evidence-based medicine, yet a growing body of research shows that this problem is widespread. Efficacy data from drug regulatory agencies, e.g., the US Food and Drug Administration (FDA), can serve as a benchmark or control against which data in journal articles can be checked. Thus one may determine whether publication bias is present and quantify the extent to which it inflates apparent drug efficacy. METHODS AND FINDINGS: FDA Drug Approval Packages for eight second-generation antipsychotics-aripiprazole, iloperidone, olanzapine, pali
View details →