Replication FailureOpen accessComputer Science
Sayash Kapoor, Arvind Narayanan · 2023 · Patterns
Machine-learning (ML) methods have gained prominence in the quantitative sciences. However, there are many known methodological pitfalls, including data leakage, in ML-based science. We systematically investigate reproducibility issues in ML-based science. Through a survey of literature in fields that have adopted ML methods, we find 17 fields where leakage has been found, collectively affecting 294 papers and, in some cases, leading to wildly overoptimistic conclusions. Based on our survey, we introduce a detailed taxonomy of eight types of leakage, ranging from textbook errors to open resear
View details →Negative / Null Result ReportOpen accessComputer Science
Troels F. Rønnow, Zhihui Wang, Joshua Job et al. · 2014 · Science
The development of small-scale quantum devices raises the question of how to fairly assess and detect quantum speedup. Here, we show how to define and measure quantum speedup and how to avoid pitfalls that might mask or fake such a…
View details →Negative / Null Result ReportComputer Science
Youngjoon Choi, Miju Choi, Munhyang Oh et al. · 2019 · Journal of Hospitality Marketing & Management
Hotel industry started to adopt service robots, which are considered a future workforce. However, no attempt was conducted to examine the dimensionality of service quality of service robots. This paper aims to understand the influence of…
View details →Negative / Null Result ReportOpen accessComputer Science
Jafar Tanha, Yousef Abdi, Negin Samadi et al. · 2020 · Journal Of Big Data
Abstract Since canonical machine learning algorithms assume that the dataset has equal number of samples in each class, binary classification became a very challenging task to discriminate the minority class samples efficiently in imbalanced datasets. For this reason, researchers have been paid attention and have proposed many methods to deal with this problem, which can be broadly categorized into data level and algorithm level. Besides, multi-class imbalanced learning is much harder than binary one and is still an open problem. Boosting algorithms are a class of ensemble learning methods in
View details →Negative / Null Result ReportComputer Science
Petra Valíčková, Tomáš Havránek, Roman Horváth · 2014 · Journal of Economic Surveys
Abstract We analyze 1334 estimates from 67 studies that examine the effect of financial development on economic growth. Taken together, the studies imply a positive and statistically significant effect, but the individual estimates vary…
View details →Negative / Null Result ReportOpen accessComputer Science
Frederick M. Howard, James M. Dolezal, Sara Kochanny et al. · 2021 · Nature Communications
The Cancer Genome Atlas (TCGA) is one of the largest biorepositories of digital histology. Deep learning (DL) models have been trained on TCGA to predict numerous features directly from histology, including survival, gene expression patterns, and driver mutations. However, we demonstrate that these features vary substantially across tissue submitting sites in TCGA for over 3,000 patients with six cancer subtypes. Additionally, we show that histologic image differences between submitting sites can easily be identified with DL. Site detection remains possible despite commonly used color normaliz
View details →Negative / Null Result ReportOpen accessComputer Science
Indah Lestari · 2015 · Formatif Jurnal Ilmiah Pendidikan MIPA
<p>The purpose of this research was to the determinate the effect of study time on <br />mathematics learning outcomes. To determinate the effect of interest in earning the mathematics learning outcomes. To determinate the…
View details →Negative / Null Result ReportComputer Science
James R. Lewis · 2018 · International Journal of Human-Computer Interaction
The primary purpose of this research was to investigate the relationship between two widely used questionnaires designed to measure perceived usability: the Computer System Usability Questionnaire (CSUQ) and the System Usability Scale…
View details →Negative / Null Result ReportOpen accessComputer Science
Christian Conrad, Anessa Custovic, Éric Ghysels · 2018 · Journal of risk and financial management
We use the GARCH-MIDAS model to extract the long- and short-term volatility components of cryptocurrencies. As potential drivers of Bitcoin volatility, we consider measures of volatility and risk in the US stock market as well as a measure of global economic activity. We find that S&P 500 realized volatility has a negative and highly significant effect on long-term Bitcoin volatility. The finding is atypical for volatility co-movements across financial markets. Moreover, we find that the S&P 500 volatility risk premium has a significantly positive effect on long-term Bitcoin volatility
View details →Negative / Null Result ReportOpen accessComputer Science
Marco Gui, Gianluca Argentin · 2011 · New Media & Society
This article outlines the main results and methodological challenges of a large-scale survey on actual digital skills. A test covering three main dimensions of digital literacy (theoretical, operational and evaluation skills) was…
View details →Negative / Null Result ReportOpen accessComputer Science
Geoffrey Gorisse, Olivier Christmann, Étienne Armand Amato et al. · 2017 · Frontiers in Robotics and AI
Current design of virtual reality (VR) applications relies essentially on the transposition of users' viewpoint in first-person perspective (1PP). Within this context, our research aims to compare the impact and the potentialities enabled via the integration of the third-person perspective (3PP) in immersive virtual environments (IVE). Our empirical study is conducted in order to assess the sense of presence, the sense of embodiment and performance of users confronted with a series of tasks presenting a case of potential use for the video game industry. Our results do not reveal significant di
View details →Negative / Null Result ReportComputer Science
Deanna D. Caputo, Shari Lawrence Pfleeger, Jesse D. Freeman et al. · 2013 · IEEE Security & Privacy
To explore the effectiveness of embedded training, researchers conducted a large-scale experiment that tracked workers' reactions to a series of carefully crafted spear phishing emails and a variety of immediate training and awareness…
View details →Negative / Null Result ReportOpen accessComputer Science
Anita Nanda, Bibhuti Bhusan Mohapatra, Abikesh Prasada Kumar Mahapatra et al. · 2021 · International Journal of Statistics and Applied Mathematics
Examining a huge amount of data is a typical issue in any research process. However, different statistical processes and techniques play essential role to derive a meaningful conclusion from the presented enormous data. Control of type I…
View details →Negative / Null Result ReportOpen accessComputer Science
Godfrey Tan, John V. Guttag · 2026 · arXiv (Cornell University)
The performance seen by individual clients on a wireless local area network (WLAN) is heavily influenced by the manner in which wireless channel capacity is allocated. The popular MAC protocol DCF (Distributed Coordination Function) used…
View details →Negative / Null Result ReportOpen accessComputer Science
Hélder Sebastião, Pedro Godinho · 2021 · Financial Innovation
This study examines the predictability of three major cryptocurrencies-bitcoin, ethereum, and litecoin-and the profitability of trading strategies devised upon machine learning techniques (e.g., linear models, random forests, and support vector machines). The models are validated in a period characterized by unprecedented turmoil and tested in a period of bear markets, allowing the assessment of whether the predictions are good even when the market direction changes between the validation and test periods. The classification and regression methods use attributes from trading and network activi
View details →Negative / Null Result ReportOpen accessComputer Science
Michel E. Vandenberghe, Marietta Scott, Paul W. Scorer et al. · 2017 · Scientific Reports
Tissue biomarker scoring by pathologists is central to defining the appropriate therapy for patients with cancer. Yet, inter-pathologist variability in the interpretation of ambiguous cases can affect diagnostic accuracy. Modern artificial intelligence methods such as deep learning have the potential to supplement pathologist expertise to ensure constant diagnostic accuracy. We developed a computational approach based on deep learning that automatically scores HER2, a biomarker that defines patient eligibility for anti-HER2 targeted therapies in breast cancer. In a cohort of 71 breast tumour r
View details →Negative / Null Result ReportOpen accessComputer Science
Fazle Karim, Somshubra Majumdar, Houshang Darabi · 2019 · IEEE Access
Long short-term memory fully convolutional neural networks (LSTM-FCNs) and Attention LSTM-FCN (ALSTM-FCN) have shown to achieve the state-of-the-art performance on the task of classifying time series signals on the old University of…
View details →Negative / Null Result ReportComputer Science
Gang Wang, Christo Wilson, Xiaohan Zhao et al. · 2012
Popular Internet services in recent years have shown that remarkable things can be achieved by harnessing the power of the masses using crowd-sourcing systems. However, crowd-sourcing systems can also pose a real challenge to existing…
View details →Negative / Null Result ReportComputer Science
Ala Al‐Fuqaha, Abdallah Khreishah, Mohsen Guizani et al. · 2015 · IEEE Communications Magazine
Several divergent application protocols have been proposed for Internet of Things (IoT) solutions including CoAP, REST, XMPP, AMQP, MQTT, DDS, and others. Each protocol focuses on a specific aspect of IoT communications. The lack of a…
View details →Negative / Null Result ReportOpen accessComputer Science
Gintare Karolina Dziugaite, Daniel M. Roy, Zoubin Ghahramani · 2015 · arXiv (Cornell University)
We consider training a deep neural network to generate samples from an unknown distribution given i.i.d. data. We frame learning as an optimization minimizing a two-sample test statistic---informally speaking, a good generator network…
View details →Negative / Null Result ReportComputer Science
Guido Makransky, Gustav Bøg Petersen, Sara Klingenberg · 2020 · British Journal of Educational Technology
Abstract Science‐related competencies are demanded in many fields, but attracting more students to scientific educations remains a challenge. This paper uses two studies to investigate the value of using Immersive Virtual Reality (IVR)…
View details →Replication FailureOpen accessComputer Science
Luana Micallef, Pierre Dragicevic, Jean‐Daniel Fekete · 2012 · IEEE Transactions on Visualization and Computer Graphics
People have difficulty understanding statistical information and are unaware of their wrong judgments, particularly in Bayesian reasoning. Psychology studies suggest that the way Bayesian problems are represented can impact comprehension,…
View details →Negative / Null Result ReportComputer Science
Elie Bouri, Luis A. Gil‐Alana, Rangan Gupta et al. · 2018 · International Journal of Finance & Economics
Abstract Motivated by the emergence of Bitcoin as a speculative financial investment, the purpose of this paper is to examine the persistence in the level and volatility of Bitcoin price, accounting for the impact of structural breaks.…
View details →Negative / Null Result ReportOpen accessComputer Science
Lee D. Walsh, G. Lorimer Moseley, Janet L. Taylor et al. · 2011 · The Journal of Physiology
The sense of body ownership, knowledge that parts of our body ‘belong’ to us, is presumably developed using sensory information. Cutaneous signals seem ideal for this and can modify the sense of ownership. For example, an illusion of…
View details →Negative / Null Result ReportOpen accessComputer Science
Moritz Beller, Georgios Gousios, Annibale Panichella et al. · 2015
The research community in Software Engineering and Software Testing in particular builds many of its contributions on a set of mutually shared expectations. Despite the fact that they form the basis of many publications as well as…
View details →Negative / Null Result ReportOpen accessComputer Science
Sunbok Lee, Jae Young Chung · 2019 · Applied Sciences
A dropout early warning system enables schools to preemptively identify students who are at risk of dropping out of school, to promptly react to them, and eventually to help potential dropout students to continue their learning for a better future. However, the inherent class imbalance between dropout and non-dropout students could pose difficulty in building accurate predictive modeling for a dropout early warning system. The present study aimed to improve the performance of a dropout early warning system: (a) by addressing the class imbalance issue using the synthetic minority oversampling t
View details →Negative / Null Result ReportOpen accessComputer Science
Peter E. Clark, Oren Etzioni, Tushar Khot et al. · 2016 · Proceedings of the AAAI Conference on Artificial Intelligence
What capabilities are required for an AI system to pass standard 4th Grade Science Tests? Previous work has examined the use of Markov Logic Networks (MLNs) to represent the requisite background knowledge and interpret test questions, but…
View details →Negative / Null Result ReportOpen accessComputer Science
Mary McGlohon, Natalie Glance, Zach Reiter · 2010 · Proceedings of the International AAAI Conference on Web and Social Media
Given a set of reviews of products or merchants from a wide range of authors and several reviews websites, how can we measure the true quality of the product or merchant? How do we remove the bias of individual authors or sources? How do…
View details →Null DatasetOpen accessComputer Science
Yu Liu, Qichun Wei, Guocan Yu et al. · 2014 · Database
Experience in clinical practice and research in systems pharmacology suggested the limitations of the current one-drug-one-target paradigm in new drug discovery. Single-target drugs may not always produce desired physiological effects on the entire biological system, even if they have successfully regulated the activities of their designated targets. On the other hand, multicomponent therapy, in which two or more agents simultaneously interact with multiple targets, has attracted growing attention. Many drug combinations consisting of multiple agents have already entered clinical practice, esp
View details →Replication FailureOpen accessComputer Science
Yang Yang, Wu Youyou, Brian Uzzi · 2020 · Proceedings of the National Academy of Sciences
Replicability tests of scientific papers show that the majority of papers fail replication. Moreover, failed papers circulate through the literature as quickly as replicating papers. This dynamic weakens the literature, raises research…
View details →