A Novel Deep Learning-Based Framework for Semantic Image Retrieval Using Multi-Scale Attention and Contrastive Learning

Semantic image retrieval plays a vital role in various domains, including healthcare, e-commerce, and multimedia systems, where accurate and efficient retrieval of semantically relevant images is essential. This paper presents a novel deep learning-based framework for semantic image retrieval that integrates multi-scale attention mechanisms and hybrid contrastive learning to address critical limitations of existing methods. The proposed framework dynamically captures global and local features across varying scales, ensuring robustness to spatial and contextual variations, while the hybrid contrastive learning strategy enhances inter-class separability and intra-class compactness in the embedding space. The framework's performance was evaluated on three benchmark datasets—ImageNet, Oxford5k, and Paris6k—utilizing key metrics such as mean average precision (mAP), recall, precision, F1-score, and retrieval time. The proposed method consistently demonstrated high accuracy and computational efficiency, with mAP scores of 0.903, 0.891, and 0.879 on ImageNet, Oxford5k, and Paris6k, respectively, and an average retrieval time of 9.65 ms per query. These results indicate the framework's capacity to deliver robust and scalable performance across diverse datasets. This study underscores the potential of the proposed framework for large-scale and real-time semantic image retrieval applications. By addressing challenges in fine-grained retrieval and scalability, this work establishes a new benchmark in the field and elucidates pathways for future advancements in multimodal and unsupervised learning approaches.

Authors

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icvisp64524.2024.10959465
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Novel Deep Learning-Based Framework for Semantic Image Retrieval Using Multi-Scale Attention and Contrastive Learning

C.‐J. Richard Shi, Li-Xia Sun, Xiangzheng Si
Image Retrieval and Classification Techniques
article

A Novel Deep Learning-Based Framework for Semantic Image Retrieval Using Multi-Scale Attention and Contrastive Learning

C.‐J. Richard Shi, Li-Xia Sun, Xiangzheng Si
article en

Abstract

Semantic image retrieval plays a vital role in various domains, including healthcare, e-commerce, and multimedia systems, where accurate and efficient retrieval of semantically relevant images is essential. This paper presents a novel deep learning-based framework for semantic image retrieval that integrates multi-scale attention mechanisms and hybrid contrastive learning to address critical limitations of existing methods. The proposed framework dynamically captures global and local features across varying scales, ensuring robustness to spatial and contextual variations, while the hybrid contrastive learning strategy enhances inter-class separability and intra-class compactness in the embedding space. The framework's performance was evaluated on three benchmark datasets—ImageNet, Oxford5k, and Paris6k—utilizing key metrics such as mean average precision (mAP), recall, precision, F1-score, and retrieval time. The proposed method consistently demonstrated high accuracy and computational efficiency, with mAP scores of 0.903, 0.891, and 0.879 on ImageNet, Oxford5k, and Paris6k, respectively, and an average retrieval time of 9.65 ms per query. These results indicate the framework's capacity to deliver robust and scalable performance across diverse datasets. This study underscores the potential of the proposed framework for large-scale and real-time semantic image retrieval applications. By addressing challenges in fine-grained retrieval and scalability, this work establishes a new benchmark in the field and elucidates pathways for future advancements in multimodal and unsupervised learning approaches.

Openalex Percentile: Top 71%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Novel Deep Learning-Based Framework for Semantic Image Retrieval Using Multi-Scale Attention and Contrastive Learning — C.‐J. Richard Shi, Li-Xia Sun, et al. · (2024) | TGRS Research Map | TGRS