Fine-Grained Sketch Retrieval for Multi Metric Feature Fusion with Attentional Mechanism

Sketch retrieval is one of the research topics in the fields of computer vision and image retrieval, aiming to retrieve the corresponding real images through simple drawn image sketches. The current sketch retrieval methods often use single degree variables to learn depth features, which cannot fully utilize the characteristics of the sketch itself, affecting the retrieval accuracy. Therefore, we propose a multi metric feature fusion network with attention mechanism (MFFAN) to solve this problem, which processes sketch features through attention mechanism and multi-dimensional feature fusion network (MDFN), and combines regularized multi metric triple loss (RMM-triple loss) control to control the direction of network updates, thereby improving retrieval accuracy. The purpose of incorporating attention mechanism and fusing HOG is to focus on the correlation between pixels and fully extract the feature information of the image. Calculate the distance between positive and negative samples and anchor samples through a mixed metric of regularization. The experimental results on the ShoeV2 sketch retrieval dataset show that the feature fusion network from multiple angles can extract effective features and improve the retrieval performance of sketch retrieval.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1109/icacte62428.2024.10871654
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fine-Grained Sketch Retrieval for Multi Metric Feature Fusion with Attentional Mechanism

Chi Ma, Xiaoxue Li, Xin Yang, Jianzhong Qiao
Image Retrieval and Classification Techniques
article

Fine-Grained Sketch Retrieval for Multi Metric Feature Fusion with Attentional Mechanism

Chi Ma, Xiaoxue Li, Xin Yang, Jianzhong Qiao
article en

Abstract

Sketch retrieval is one of the research topics in the fields of computer vision and image retrieval, aiming to retrieve the corresponding real images through simple drawn image sketches. The current sketch retrieval methods often use single degree variables to learn depth features, which cannot fully utilize the characteristics of the sketch itself, affecting the retrieval accuracy. Therefore, we propose a multi metric feature fusion network with attention mechanism (MFFAN) to solve this problem, which processes sketch features through attention mechanism and multi-dimensional feature fusion network (MDFN), and combines regularized multi metric triple loss (RMM-triple loss) control to control the direction of network updates, thereby improving retrieval accuracy. The purpose of incorporating attention mechanism and fusing HOG is to focus on the correlation between pixels and fully extract the feature information of the image. Calculate the distance between positive and negative samples and anchor samples through a mixed metric of regularization. The experimental results on the ShoeV2 sketch retrieval dataset show that the feature fusion network from multiple angles can extract effective features and improve the retrieval performance of sketch retrieval.

Northeastern University (CN)
Openalex Percentile: Top 73%
Image Retrieval and Classification Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Fine-Grained Sketch Retrieval for Multi Metric Feature Fusion with Attentional Mechanism — Chi Ma, Xiaoxue Li, et al. · (2024) | TGRS Research Map | TGRS