Adversarial Robustness Of Multimodal Machine Learning Models

The widespread adoption of machine learning, particularly generative models, has revolutionized productivity and capabilities. However, this progress comes with significant security risks, as adversarial attacks can subtly manipulate model predictions through imperceptible perturbations. Multimodal machine learning models, integrating data from modalities such as images and text, further expand the attack surface by enabling cross-modal exploitation. This paper examines the adversarial robustness of multimodal AI systems, focusing on text and image modalities. We analyze security challenges arising from cross-modal interactions and explore adversarial example generation techniques targeting individual modalities and shared embedding spaces. The paper concludes by identifying critical open challenges and promising research directions to enhance the security of multimodal AI systems.

Authors

Publication Details

Published
2025-06-24
DOI
https://doi.org/10.7148/2025-0248
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adversarial Robustness Of Multimodal Machine Learning Models

Mateusz Kowalczyk, Joanna Kołodziej, Mateusz Krzysztoń, Karolina Seweryn
Adversarial Robustness in Machine Learning
article

Adversarial Robustness Of Multimodal Machine Learning Models

Mateusz Kowalczyk, Joanna Kołodziej, Mateusz Krzysztoń, Karolina Seweryn
article en

Abstract

The widespread adoption of machine learning, particularly generative models, has revolutionized productivity and capabilities. However, this progress comes with significant security risks, as adversarial attacks can subtly manipulate model predictions through imperceptible perturbations. Multimodal machine learning models, integrating data from modalities such as images and text, further expand the attack surface by enabling cross-modal exploitation. This paper examines the adversarial robustness of multimodal AI systems, focusing on text and image modalities. We analyze security challenges arising from cross-modal interactions and explore adversarial example generation techniques targeting individual modalities and shared embedding spaces. The paper concludes by identifying critical open challenges and promising research directions to enhance the security of multimodal AI systems.

Openalex Percentile: Top 91%
Adversarial Robustness in Machine Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.