Boosting feature representation for enhanced unsupervised landmark detection

Landmark detection is a crucial task that focuses on identifying specific landmarks representing distinct object features within an image. However, existing methods primarily adopt Convolutional Neural Networks as the backbone for feature extraction, which struggle to capture global contextual information. Due to the structural dependencies of landmarks, these methods fail to effectively utilize these relationships, leading to lower detection accuracy. To overcome these limitations, we propose a novel framework, CTBN, which combines CNNs, Transformer, and Convolutional Block Attention Modules to enhance feature representation for landmark detection. In our framework, CNNs extract fine-grained local features, Transformer captures global context, and CBAM adaptively refinesfeatures by focusing on important regions and channels. We validate our performance on multiple datasets, including CelebA, AFLW and Deepfashion. The experiments demonstrate that our method achieves superior performance, significantly improves the accuracy of landmark detection.

Authors

Institutions

Publication Details

Published
2024-10-03
DOI
https://doi.org/10.1117/12.3048400
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Boosting feature representation for enhanced unsupervised landmark detection

Jianlin Zhang, Dongxu Liu, Meihui Li, Yiping Han
Advanced Image and Video Retrieval Techniques
article

Boosting feature representation for enhanced unsupervised landmark detection

Jianlin Zhang, Dongxu Liu, Meihui Li, Yiping Han
article en

Abstract

Landmark detection is a crucial task that focuses on identifying specific landmarks representing distinct object features within an image. However, existing methods primarily adopt Convolutional Neural Networks as the backbone for feature extraction, which struggle to capture global contextual information. Due to the structural dependencies of landmarks, these methods fail to effectively utilize these relationships, leading to lower detection accuracy. To overcome these limitations, we propose a novel framework, CTBN, which combines CNNs, Transformer, and Convolutional Block Attention Modules to enhance feature representation for landmark detection. In our framework, CNNs extract fine-grained local features, Transformer captures global context, and CBAM adaptively refinesfeatures by focusing on important regions and channels. We validate our performance on multiple datasets, including CelebA, AFLW and Deepfashion. The experiments demonstrate that our method achieves superior performance, significantly improves the accuracy of landmark detection.

State Key Laboratory on Integrated Optoelectronics (CN), Institute of Optics and Electronics, Chinese Academy of Sciences (CN)
Sustainable cities and communities
Openalex Percentile: Top 83%
Advanced Image and Video Retrieval Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.