Robust vision language semantic alignment for fine grained cultural heritage retrieval

With the growing demand for the digital preservation of cultural heritage, achieving precise alignment between image and textual information in complex environments has become a critical challenge in the fields of computer vision and artificial intelligence. Existing methods often encounter difficulties when processing cultural heritage data characterized by substantial noise and strong domain specificity, leading to insufficient cross-modal semantic alignment and limited robustness. This paper proposes Cross-Domain Vision-Language Reasoning for Domain-Specific Artifact Scenes (CD-VLR), a cross-modal interaction modeling method designed for complex cultural heritage environments. The core of the proposed approach lies in the design of a multimodal feature fusion module and an adaptive denoising mechanism, which together enable deep semantic alignment between images and texts while maintaining stable performance under noisy conditions. Experimental results demonstrate that the proposed method achieves an accuracy of 93.1% and an F1-score of 90.8% on the cross-modal image-text retrieval task using a self-constructed cultural heritage dataset, outperforming advanced baseline methods and exhibiting stronger robustness in noisy environments. This study provides an effective technical framework for cross-modal understanding of cultural heritage, advancing research on multimodal fusion methods and offering a feasible solution for digital archiving and intelligent interpretation of cultural heritage.

Authors

Institutions

Publication Details

Journal
Discover Artificial Intelligence
Published
2026-06-17
DOI
https://doi.org/10.1007/s44163-026-01596-3
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Robust vision language semantic alignment for fine grained cultural heritage retrieval

Jiahui Zhou, Xue Bai
Discover Artificial Intelligence
Multimodal Machine Learning Applications
article

Robust vision language semantic alignment for fine grained cultural heritage retrieval

Jiahui Zhou, Xue Bai
article en

Abstract

With the growing demand for the digital preservation of cultural heritage, achieving precise alignment between image and textual information in complex environments has become a critical challenge in the fields of computer vision and artificial intelligence. Existing methods often encounter difficulties when processing cultural heritage data characterized by substantial noise and strong domain specificity, leading to insufficient cross-modal semantic alignment and limited robustness. This paper proposes Cross-Domain Vision-Language Reasoning for Domain-Specific Artifact Scenes (CD-VLR), a cross-modal interaction modeling method designed for complex cultural heritage environments. The core of the proposed approach lies in the design of a multimodal feature fusion module and an adaptive denoising mechanism, which together enable deep semantic alignment between images and texts while maintaining stable performance under noisy conditions. Experimental results demonstrate that the proposed method achieves an accuracy of 93.1% and an F1-score of 90.8% on the cross-modal image-text retrieval task using a self-constructed cultural heritage dataset, outperforming advanced baseline methods and exhibiting stronger robustness in noisy environments. This study provides an effective technical framework for cross-modal understanding of cultural heritage, advancing research on multimodal fusion methods and offering a feasible solution for digital archiving and intelligent interpretation of cultural heritage.

Discover Artificial Intelligence
Tianjin University of Technology and Education (CN)
Sustainable cities and communities
Openalex Percentile: Top 6%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.