Transfusing Dense Matcher Experience into Sparse Keypoint Detectors in Weak-Texture Scenes

Sparse keypoint matching is essential for many vision tasks but often suffers in weak-texture scenes due to a lack of distinctive local features. We present a dense-to-sparse knowledge distillation framework that transfers multi-scale descriptors from a high-capacity dense matcher to a sparse keypoint detector. We align the teacher's feature pyramid via orthogonal projections and parameter-free channel attention, fuse them into a unified embedding, and use the teacher's match confidence to guide region selection. A composite loss enforces descriptor alignment, supervises keypoint confidence, and encourages homography-based consistency. On an indoor weak-texture benchmark, our distilled SiLK-D2S achieves up to 14.71% improvement in HEA and 4.17% gain in repeatability over the original SiLK, while maintaining real-time performance.

Authors

Institutions

Publication Details

Published
2025-06-20
DOI
https://doi.org/10.1109/caibda65784.2025.11182970
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transfusing Dense Matcher Experience into Sparse Keypoint Detectors in Weak-Texture Scenes

Jingchun Cheng, Ningfang Song, Xiong Pan, Xiaoxin Liu et al.
3D Shape Modeling and Analysis
article

Transfusing Dense Matcher Experience into Sparse Keypoint Detectors in Weak-Texture Scenes

Jingchun Cheng, Ningfang Song, Xiong Pan, Xiaoxin Liu, Jiajie Song
article en

Abstract

Sparse keypoint matching is essential for many vision tasks but often suffers in weak-texture scenes due to a lack of distinctive local features. We present a dense-to-sparse knowledge distillation framework that transfers multi-scale descriptors from a high-capacity dense matcher to a sparse keypoint detector. We align the teacher's feature pyramid via orthogonal projections and parameter-free channel attention, fuse them into a unified embedding, and use the teacher's match confidence to guide region selection. A composite loss enforces descriptor alignment, supervises keypoint confidence, and encourages homography-based consistency. On an indoor weak-texture benchmark, our distilled SiLK-D2S achieves up to 14.71% improvement in HEA and 4.17% gain in repeatability over the original SiLK, while maintaining real-time performance.

Beihang University (CN)
Openalex Percentile: Top 70%
3D Shape Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.