Large Language Models Can be Good Medical Annotators: A Case Study of Drug Change Detection in Japanese EHRs.
Ito T; Yoshie T; Yoshimura S; Ohara N; Yada S; Wakamiya S; Aramaki E · 2025 · Studies in health technology and informatics
WASTE classifies this as Failed Experiment Report · AI classification, approximate
An experimental approach did not work as intended — learn what to avoid before investing the same effort.
Abstract (excerpt)
In this study, we combined automatically generated labels from large language models (LLMs) with a small number of manual annotations to classify adverse event-related treatment discontinuations in Japanese EHRs. By fine-tuning JMedRoBERTa…
Excerpt shown for reference under fair use — read the full paper at the publisher.
Hosted by the publisher — may require access.
About to run something similar?
Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.
Related failures
A Randomized Trial of Intraarterial Treatment for Acute Ischemic Stroke
Negative / Null Result ReportDuodenal Infusion of Donor Feces for Recurrent Clostridium difficile
Negative / Null Result ReportStenting versus Endarterectomy for Treatment of Carotid-Artery Stenosis
Negative / Null Result ReportEffects of Combination Lipid Therapy in Type 2 Diabetes Mellitus
Replication FailureA Randomized Trial of Bevacizumab for Newly Diagnosed Glioblastoma
Negative / Null Result ReportSpironolactone for Heart Failure with Preserved Ejection Fraction
WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.
Metadata source: Europe PMC · DOI 10.3233/shti251017