CSStereo: A UAV scenarios stereo matching network enhanced with contrastive learning and feature selection
Stereo matching is essential for establishing pixel-level correspondences and estimating depth in scene reconstruction. However, applying stereo matching networks to UAV scenarios presents unique challenges due to varying altitudes, angles, and rapidly changing conditions, unlike the controlled settings in autonomous driving or the uniform scenes in satellite imagery. To address these UAV-specific challenges, we propose the CSStereo network (Contrastive Learning and Feature Selection Stereo Matching Network), which integrates contrastive learning and feature selection modules. The contrastive learning module enhances feature representation by comparing similarities and differences between samples, thereby improving discrimination among features in UAV scenarios. The feature selection module enhances robustness and generalization across different UAV scenarios by selecting relevant and informative features. Extensive experimental evaluations demonstrate the effectiveness of CSStereo in UAV scenarios, and show superior performance in both qualitative and quantitative assessments. • CSStereo is a proposed stereo matching network designed for UAV-specific scenarios. • CSStereo improves feature extraction with contrastive learning and feature selection. • Experimental results confirm the model’s effectiveness in UAV stereo matching tasks.
Authors
- Shuhui Bu (ORCID: https://orcid.org/0000-0002-9853-8313)
- Wenshuai Yu (ORCID: https://orcid.org/0000-0002-2730-0818)
- Anzhu Yu (ORCID: https://orcid.org/0000-0002-3332-9668)
- Xiaoyi Zhang (ORCID: https://orcid.org/0000-0002-7761-3468)
- Xuefeng Cao (ORCID: https://orcid.org/0000-0003-0529-3538)
Institutions
- PLA Information Engineering University (CN)
- Northwestern Polytechnical University (CN)
- Shenzhen University (CN)
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2024-10-07
- DOI
- https://doi.org/10.1016/j.jag.2024.104189
- Citations
- 2
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.50
Funders
- National Natural Science Foundation of China