An Unsupervised Multimodal Semantic-Enhanced Entity Alignment Method Based on Large Language Models

Multimodal entity alignment identifies equivalent entities referring to the same real-world object across heterogeneous multimodal knowledge graphs and is essential for multi-source knowledge integration. Existing methods often rely on manually labeled seed alignments and multimodal feature similarity, limiting their ability to capture implicit semantic equivalence under heterogeneous attribute and relation expressions. Large language models (LLMs) offer strong semantic understanding and reasoning capabilities for unsupervised alignment, but their direct application remains challenging because of the large entity search space, redundant knowledge graph information, and the stochasticity of LLM inference. To address these challenges, we propose MEA-LLM, an LLM-based fully unsupervised multimodal semantic-enhanced entity alignment method. MEA-LLM first pre-screens candidate entities by jointly exploiting multimodal similarities derived from visual, attribute, and relational information. It then selects discriminative attributes and relations based on degree of freedom, candidate frequency, and discriminability for LLM reasoning. Multiple inference and result aggregation are further employed to improve robustness. Experiments on FB-DB15K and FB-YAGO15K show that MEA-LLM outperforms existing methods across multiple evaluation metrics. Further ablation studies, hyperparameter analyses, experiments with different model-scales, and efficiency evaluations demonstrate the effectiveness of the core components and indicate that MEA-LLM achieves a favorable trade-off between entity alignment performance and inference cost.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-10-26
DOI
https://doi.org/10.3390/app162110590
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Unsupervised Multimodal Semantic-Enhanced Entity Alignment Method Based on Large Language Models

Yuhui Ma, Ziyu Guo, Li Feng, Bingbing Zheng et al.
Applied Sciences
Multimodal Machine Learning Applications
article

An Unsupervised Multimodal Semantic-Enhanced Entity Alignment Method Based on Large Language Models

Yuhui Ma, Ziyu Guo, Li Feng, Bingbing Zheng, Yingdi Wang
article en

Abstract

Multimodal entity alignment identifies equivalent entities referring to the same real-world object across heterogeneous multimodal knowledge graphs and is essential for multi-source knowledge integration. Existing methods often rely on manually labeled seed alignments and multimodal feature similarity, limiting their ability to capture implicit semantic equivalence under heterogeneous attribute and relation expressions. Large language models (LLMs) offer strong semantic understanding and reasoning capabilities for unsupervised alignment, but their direct application remains challenging because of the large entity search space, redundant knowledge graph information, and the stochasticity of LLM inference. To address these challenges, we propose MEA-LLM, an LLM-based fully unsupervised multimodal semantic-enhanced entity alignment method. MEA-LLM first pre-screens candidate entities by jointly exploiting multimodal similarities derived from visual, attribute, and relational information. It then selects discriminative attributes and relations based on degree of freedom, candidate frequency, and discriminability for LLM reasoning. Multiple inference and result aggregation are further employed to improve robustness. Experiments on FB-DB15K and FB-YAGO15K show that MEA-LLM outperforms existing methods across multiple evaluation metrics. Further ablation studies, hyperparameter analyses, experiments with different model-scales, and efficiency evaluations demonstrate the effectiveness of the core components and indicate that MEA-LLM achieves a favorable trade-off between entity alignment performance and inference cost.

Applied SciencesVol. 16(21)
Chinese Academy of Sciences (CN), Aerospace Information Research Institute (CN), University of Chinese Academy of Sciences (CN)
Openalex Percentile: Top 16%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon