SEVD: Mitigating Object Hallucinations in Multimodal Large Language Models via Semantic Evidence Verification Decoding

Multimodal large language models (MLLMs) have demonstrated strong capabilities in visual understanding and open-ended generation, yet they remain prone to hallucination, where generated content is inconsistent with or unsupported by the visual input. Existing training-free decoding methods mainly intervene through token-level generation scores or output distributions, while the semantic content represented by candidate tokens is not explicitly verified. We propose Semantic Evidence Verification Decoding (SEVD), a training-free decoding method that elevates hallucination mitigation from token-level intervention to semantic-level verification. SEVD first constructs explicit semantic units from candidate tokens, performs semantic evidence verification by comparing how the model's support for the same semantic unit changes when visual evidence is preserved, weakened, or removed, and finally maps the resulting outcomes back to decoding decisions through selective intervention. Extensive experiments across different MLLM backbones and benchmarks demonstrate substantial hallucination mitigation while preserving general multimodal capability, supporting the effectiveness and transferability of SEVD. Code repository: https://github.com/sielan479-wq/SEVD

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-26
DOI
https://doi.org/10.5281/zenodo.23663054
Primary Topic
Multimodal Machine Learning Applications
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

SEVD: Mitigating Object Hallucinations in Multimodal Large Language Models via Semantic Evidence Verification Decoding

Siqi Feng, Ying Guo, Wei Song
Zenodo (CERN European Organization for Nuclear Research)
Multimodal Machine Learning Applications
preprint

SEVD: Mitigating Object Hallucinations in Multimodal Large Language Models via Semantic Evidence Verification Decoding

Siqi Feng, Ying Guo, Wei Song
preprint en

Abstract

Multimodal large language models (MLLMs) have demonstrated strong capabilities in visual understanding and open-ended generation, yet they remain prone to hallucination, where generated content is inconsistent with or unsupported by the visual input. Existing training-free decoding methods mainly intervene through token-level generation scores or output distributions, while the semantic content represented by candidate tokens is not explicitly verified. We propose Semantic Evidence Verification Decoding (SEVD), a training-free decoding method that elevates hallucination mitigation from token-level intervention to semantic-level verification. SEVD first constructs explicit semantic units from candidate tokens, performs semantic evidence verification by comparing how the model's support for the same semantic unit changes when visual evidence is preserved, weakened, or removed, and finally maps the resulting outcomes back to decoding decisions through selective intervention. Extensive experiments across different MLLM backbones and benchmarks demonstrate substantial hallucination mitigation while preserving general multimodal capability, supporting the effectiveness and transferability of SEVD. Code repository: https://github.com/sielan479-wq/SEVD

Zenodo (CERN European Organization for Nuclear Research)
North China University of Technology (CN)
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
SEVD: Mitigating Object Hallucinations in Multimodal Large Language Models via Semantic Evidence Verification Decoding — Siqi Feng, Ying Guo, et al. · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS