M3: A Multi-Image Multi-Modal Entity Alignment Dataset
Multi-modal Entity Alignment (MMEA) aims to identify equivalent entities across different multi-modal knowledge graphs (MMKGs), facilitating their integration and enhancing coverage. However, current MMEA datasets have limitations, including low entity coverage, a single image per entity, high inter-image correlation, and images sourced from the same search engine, which do not reflect real-world challenges. The fair comparison and development of alignment solutions may be hindered by these oversimplified scenarios. To address this problem, in this work, we first construct M3, an MMEA benchmark equipped with multiple images from different search engines in real-world scenarios. Additionally, we design a simple and universal multi-image processing module (AMIA), which assigns varying attention weights to images associated with entities to effectively model visual information. Experimental results validate the difficulty of M3, as well as the effectiveness of AMIA. Despite the superior performance of AMIA, there is still room for developing more advanced solutions to address these difficulties. Our dataset is publicly released.
Authors
- Xiang Zhao (ORCID: https://orcid.org/0000-0001-6339-0219)
- Shiqi Zhang (ORCID: https://orcid.org/0009-0005-6140-6578)
- Weixin Zeng (ORCID: https://orcid.org/0000-0002-2690-3190)
- Zhen Tan (ORCID: https://orcid.org/0000-0001-8643-4683)
- Weidong Xiao (ORCID: https://orcid.org/0000-0002-6957-3769)
Institutions
- National University of Defense Technology (CN)
Publication Details
- Published
- 2024-10-20
- DOI
- https://doi.org/10.1145/3627673.3679126
- Citations
- 1
- Primary Topic
- Image Retrieval and Classification Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.25