Alignment in Multimodal Large Language Models: A Survey

Multimodal large language models (MLLMs) can generate fluent responses but may overlook relevant evidence or violate task and safety constraints. This survey examines MLLM alignment through two complementary gaps: the Modality Gap, concerning cross-modal correspondence and the use of task-relevant evidence, and the Intent Gap, concerning behavior relative to specified goals, constraints, and human expectations. We organize the literature along six dimensions: architecture, objective functions, data construction, training, evaluation, and applications. Across these dimensions, we link alignment mechanisms and supervision assumptions to the failures they target and the evidence supporting their effectiveness. Our analysis clarifies what interface compatibility, target imitation, preference learning, and verifiable rewards can each demonstrate about alignment, together with the limitations of their underlying supervision. We further summarize evaluation at the representation, task, and behavior levels, emphasizing evidence dependence, constraint compliance, and the distinction between observed improvements and explanations of their underlying mechanisms. Applications in robotics, safety, healthcare, recommendation, and climate decision support reveal three recurring requirements: traceable evidence, valid supervision, and decisions that respect domain constraints. Building on this synthesis, we identify four research directions: evidence-consistent alignment across modalities, verified self-correction and test-time alignment, diagnosis-guided repair, and reliable transfer to underrepresented settings.

Authors

Publication Details

Journal
Preprints.org
Published
2026-10-29
DOI
https://doi.org/10.20944/preprints202610.1245.v3
Primary Topic
Multimodal Machine Learning Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Alignment in Multimodal Large Language Models: A Survey

Ling Yue, Ranjay Krishna, Linsey Xiaolin Pang, Philip S. Yu et al.
1 links
Preprints.org
Multimodal Machine Learning Applications
preprint

Alignment in Multimodal Large Language Models: A Survey

Ling Yue, Ranjay Krishna, Linsey Xiaolin Pang, Philip S. Yu, Jiayuan Ding, Mingdai Yang, Qingsong Wen, Zenglin Xu, Connor Lee, Zhiwei Liu, Yan Liu, Yifan Zhang, Yiming Xu, Zheng Zhao, Jiaxing Zhang, Lucas Ni, Yuyao Yang, Zixian Ma, Huayi Yang, Jialiang Yin
preprint en

Abstract

Multimodal large language models (MLLMs) can generate fluent responses but may overlook relevant evidence or violate task and safety constraints. This survey examines MLLM alignment through two complementary gaps: the Modality Gap, concerning cross-modal correspondence and the use of task-relevant evidence, and the Intent Gap, concerning behavior relative to specified goals, constraints, and human expectations. We organize the literature along six dimensions: architecture, objective functions, data construction, training, evaluation, and applications. Across these dimensions, we link alignment mechanisms and supervision assumptions to the failures they target and the evidence supporting their effectiveness. Our analysis clarifies what interface compatibility, target imitation, preference learning, and verifiable rewards can each demonstrate about alignment, together with the limitations of their underlying supervision. We further summarize evaluation at the representation, task, and behavior levels, emphasizing evidence dependence, constraint compliance, and the distinction between observed improvements and explanations of their underlying mechanisms. Applications in robotics, safety, healthcare, recommendation, and climate decision support reveal three recurring requirements: traceable evidence, valid supervision, and decisions that respect domain constraints. Building on this synthesis, we identify four research directions: evidence-consistent alignment across modalities, verified self-correction and test-time alignment, diagnosis-guided repair, and reliable transfer to underrepresented settings.

Preprints.org
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon