Red Teaming Multimodal Language Models: Evaluating Harm Across Prompt Modalities and Models
Madison Van Doren; Casey Ford; Emily Dix · 2025 · arXiv.org
WASTE classifies this as Failed Experiment Report · AI classification, approximate
An experimental approach did not work as intended — learn what to avoid before investing the same effort.
Abstract (excerpt)
Multimodal large language models (MLLMs) are increasingly used in real world applications, yet their safety under adversarial conditions remains underexplored. This study evaluates the harmlessness of four leading MLLMs (GPT-4o, Claude…
Excerpt shown for reference under fair use — read the full paper at the publisher.
Hosted by the publisher — may require access.
About to run something similar?
Run an AI Precheck on your own design to catch failure modes like this one before you spend the time. Your first desk check is free.
Related failures
Leakage and the reproducibility crisis in machine-learning-based science
Negative / Null Result ReportDefining and detecting quantum speedup
Negative / Null Result ReportService robots in hotels: understanding the service quality perceptions of human-robot interaction
Negative / Null Result ReportBoosting methods for multi-class imbalanced data classification: an experimental review
Negative / Null Result ReportFINANCIAL DEVELOPMENT AND ECONOMIC GROWTH: A META‐ANALYSIS
Negative / Null Result ReportThe impact of site-specific digital histology signatures on deep learning model accuracy and bias
WASTE indexes this work — it does not host or republish it. Failure-type classification is automated and approximate.
Metadata source: Semantic Scholar · DOI 10.48550/arxiv.2509.15478