Image Content Retrieval System with Multimodal Feature Fusion

Traditional image retrieval systems face significant challenges in bridging the semantic gap between low-level visual features and high-level conceptual understanding. This paper proposes a novel multimodal image retrieval system that integrates visual, semantic, and textual features through an adaptive fusion mechanism. The framework employs attentionbased weight learning to dynamically adjust modality contributions based on query characteristics, complemented by graph neural networks for modeling inter-modal relationships. A hierarchical indexing structure using locality-sensitive hashing enables efficient large-scale retrieval with logarithmic complexity. Experimental evaluation on COCO, ImageNet, and Flickr30K datasets demonstrates superior performance, achieving 87.7% mean average precision while maintaining 52.3 ms query processing time for 100 K images. The system outperforms state-of-the-art methods by 6.3% through effective multimodal synergy, with ablation studies confirming the critical role of adaptive fusion. The proposed approach offers practical solutions for e-commerce, medical imaging, and multimedia applications requiring accurate and efficient content-based retrieval.

Authors

Institutions

Publication Details

Published
2025-08-15
DOI
https://doi.org/10.1109/cvaa66438.2025.11193415
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Image Content Retrieval System with Multimodal Feature Fusion

Yue Dai
Image Retrieval and Classification Techniques
article

Image Content Retrieval System with Multimodal Feature Fusion

Yue Dai
article en

Abstract

Traditional image retrieval systems face significant challenges in bridging the semantic gap between low-level visual features and high-level conceptual understanding. This paper proposes a novel multimodal image retrieval system that integrates visual, semantic, and textual features through an adaptive fusion mechanism. The framework employs attentionbased weight learning to dynamically adjust modality contributions based on query characteristics, complemented by graph neural networks for modeling inter-modal relationships. A hierarchical indexing structure using locality-sensitive hashing enables efficient large-scale retrieval with logarithmic complexity. Experimental evaluation on COCO, ImageNet, and Flickr30K datasets demonstrates superior performance, achieving 87.7% mean average precision while maintaining 52.3 ms query processing time for 100 K images. The system outperforms state-of-the-art methods by 6.3% through effective multimodal synergy, with ablation studies confirming the critical role of adaptive fusion. The proposed approach offers practical solutions for e-commerce, medical imaging, and multimedia applications requiring accurate and efficient content-based retrieval.

College of Accounting (SI)
Openalex Percentile: Top 72%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Image Content Retrieval System with Multimodal Feature Fusion — Yue Dai · (2025) | TGRS Research Map | TGRS