No Significant Difference - Unless you are a Jumper
Richard Fendler; Craig Ruff; Milind Shrikhande · 2018 · Online Learning
WASTE classifies this as Negative / Null Result Report · AI classification, approximate
The study found no significant effect — useful as a negative control or null benchmark for your own design.
The finding, in one line
“Much of the e-education literature suggests that there is no significant difference in aggregate student learning outcomes between online and face-to-face instruction.”
Abstract
Much of the e-education literature suggests that there is no significant difference in aggregate student learning outcomes between online and face-to-face instruction. In this study, we develop a model that forecasts the grade that individual students would have most likely earned in the alternate class setting. Students for whom the difference between the actual grade received in one class format (for example, online) and the forecasted grade in the other class setting (for example, face-to-face) is one full letter grade or higher are called “jumpers.” Our findings indicate that jumpers are n
Abstract by Richard Fendler; Craig Ruff; Milind Shrikhande, Online Learning (2018) — licensed CC BY 4.0.
About to run something similar?
Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.
Related failures
Investigating Variation in Replicability
Negative / Null Result ReportMany Labs 2: Investigating Variation in Replicability Across Samples and Settings
Failed Experiment ReportGetting Ahead in the Communist Party: Explaining the Advancement of Central Committee Members in China
Negative / Null Result ReportReducing implicit racial preferences: II. Intervention effectiveness across time.
Negative / Null Result ReportTHE IMPACT OF IMMIGRATION ON THE STRUCTURE OF WAGES: THEORY AND EVIDENCE FROM BRITAIN
Negative / Null Result ReportRevisiting the Marshmallow Test: A Conceptual Replication Investigating Links Between Early Delay of Gratification and Later Outcomes
WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.
Metadata source: OpenAlex · DOI 10.24059/olj.v22i1.887
