Transfusing Dense Matcher Experience into Sparse Keypoint Detectors in Weak-Texture Scenes
Sparse keypoint matching is essential for many vision tasks but often suffers in weak-texture scenes due to a lack of distinctive local features. We present a dense-to-sparse knowledge distillation framework that transfers multi-scale descriptors from a high-capacity dense matcher to a sparse keypoint detector. We align the teacher's feature pyramid via orthogonal projections and parameter-free channel attention, fuse them into a unified embedding, and use the teacher's match confidence to guide region selection. A composite loss enforces descriptor alignment, supervises keypoint confidence, and encourages homography-based consistency. On an indoor weak-texture benchmark, our distilled SiLK-D2S achieves up to 14.71% improvement in HEA and 4.17% gain in repeatability over the original SiLK, while maintaining real-time performance.
Authors
- Jingchun Cheng (ORCID: https://orcid.org/0000-0001-7596-5067)
- Ningfang Song (ORCID: https://orcid.org/0000-0002-5224-4643)
- Xiong Pan (ORCID: https://orcid.org/0000-0002-2540-0778)
- Xiaoxin Liu (ORCID: https://orcid.org/0000-0001-9029-4775)
- Jiajie Song
Institutions
- Beihang University (CN)
Publication Details
- Published
- 2025-06-20
- DOI
- https://doi.org/10.1109/caibda65784.2025.11182970
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00