Cross-Modal Hash Retrieval Based on Deep Learning

The exponential growth of multimedia data increasingly requires retrieval technology across different data modalities, such as searching for videos through images and searching for sounds through text. This cross-modal retrieval technology aims to explore the intrinsic semantic connections between different modalities, so that information of one modality can be retrieved from data of another modality. However, due to the difficulty of feature extraction and the high cost of data annotation, cross-modal learning is difficult and the retrieval efficiency is low. Deep learning methods have demonstrated powerful capabilities in both data processing and image processing, bringing new possibilities to solving the above cross-modal retrieval problems. Hashing methods have also been widely used in multimodal retrieval technology due to their advantages such as low storage cost and fast retrieval speed. This article summarizes the main requirements of cross modal retrieval tasks, reviews some mainstream research methods based on deep learning for cross modal hash retrieval, and finally lists some existing problems and possible future research trends in the field of cross modal retrieval, which will provide meaningful references for future researchers.

Authors

Institutions

Publication Details

Published
2024-12-22
DOI
https://doi.org/10.1109/cicn63059.2024.10847357
Citations
2
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
0.50
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-Modal Hash Retrieval Based on Deep Learning

Yan Tian, Fanqi Meng, Jingdong Wang, Kai-ping Tian
2 citations
Advanced Image and Video Retrieval Techniques
0.50
article

Cross-Modal Hash Retrieval Based on Deep Learning

Yan Tian, Fanqi Meng, Jingdong Wang, Kai-ping Tian
article en
2 citations

Abstract

The exponential growth of multimedia data increasingly requires retrieval technology across different data modalities, such as searching for videos through images and searching for sounds through text. This cross-modal retrieval technology aims to explore the intrinsic semantic connections between different modalities, so that information of one modality can be retrieved from data of another modality. However, due to the difficulty of feature extraction and the high cost of data annotation, cross-modal learning is difficult and the retrieval efficiency is low. Deep learning methods have demonstrated powerful capabilities in both data processing and image processing, bringing new possibilities to solving the above cross-modal retrieval problems. Hashing methods have also been widely used in multimodal retrieval technology due to their advantages such as low storage cost and fast retrieval speed. This article summarizes the main requirements of cross modal retrieval tasks, reviews some mainstream research methods based on deep learning for cross modal hash retrieval, and finally lists some existing problems and possible future research trends in the field of cross modal retrieval, which will provide meaningful references for future researchers.

Northeast Electric Power University (CN)
Quality Education
Openalex Percentile: Top 32%
Advanced Image and Video Retrieval Techniques
0.50
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.