Alignment in Multimodal Large Language Models: A Survey
Multimodal large language models (MLLMs) can generate fluent responses but may overlook relevant evidence or violate task and safety constraints. This survey examines MLLM alignment through two complementary gaps: the Modality Gap, concerning cross-modal correspondence and the use of task-relevant evidence, and the Intent Gap, concerning behavior relative to specified goals, constraints, and human expectations. We organize the literature along six dimensions: architecture, objective functions, data construction, training, evaluation, and applications. Across these dimensions, we link alignment mechanisms and supervision assumptions to the failures they target and the evidence supporting their effectiveness. Our analysis clarifies what interface compatibility, target imitation, preference learning, and verifiable rewards can each demonstrate about alignment, together with the limitations of their underlying supervision. We further summarize evaluation at the representation, task, and behavior levels, emphasizing evidence dependence, constraint compliance, and the distinction between observed improvements and explanations of their underlying mechanisms. Applications in robotics, safety, healthcare, recommendation, and climate decision support reveal three recurring requirements: traceable evidence, valid supervision, and decisions that respect domain constraints. Building on this synthesis, we identify four research directions: evidence-consistent alignment across modalities, verified self-correction and test-time alignment, diagnosis-guided repair, and reliable transfer to underrepresented settings.
Authors
- Ling Yue (ORCID: https://orcid.org/0009-0005-9130-5962)
- Ranjay Krishna (ORCID: https://orcid.org/0000-0001-8784-2531)
- Linsey Xiaolin Pang (ORCID: https://orcid.org/0000-0002-4784-9795)
- Philip S. Yu (ORCID: https://orcid.org/0000-0002-3491-5968)
- Jiayuan Ding (ORCID: https://orcid.org/0000-0001-5783-0062)
- Mingdai Yang (ORCID: https://orcid.org/0000-0002-2868-8965)
- Qingsong Wen (ORCID: https://orcid.org/0000-0003-4516-2524)
- Zenglin Xu (ORCID: https://orcid.org/0000-0001-5550-6461)
- Connor Lee (ORCID: https://orcid.org/0000-0001-9451-3218)
- Zhiwei Liu (ORCID: https://orcid.org/0000-0003-1525-1067)
- Yan Liu (ORCID: https://orcid.org/0000-0002-7055-9518)
- Yifan Zhang (ORCID: https://orcid.org/0000-0002-6227-0183)
- Yiming Xu (ORCID: https://orcid.org/0009-0006-2276-3692)
- Zheng Zhao (ORCID: https://orcid.org/0009-0004-3875-4585)
- Jiaxing Zhang (ORCID: https://orcid.org/0009-0007-8031-661X)
- Lucas Ni
- Yuyao Yang (ORCID: https://orcid.org/0009-0005-8818-3909)
- Zixian Ma (ORCID: https://orcid.org/0009-0006-2903-0539)
- Huayi Yang (ORCID: https://orcid.org/0009-0000-8966-2630)
- Jialiang Yin (ORCID: https://orcid.org/0009-0003-3694-4708)
Publication Details
- Journal
- Preprints.org
- Published
- 2026-10-29
- DOI
- https://doi.org/10.20944/preprints202610.1245.v3
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- preprint