Accurate 3D Depth Mapping for Robotic Vision Using Fused CNN and Edge-Preserving Cost Aggregation in Stereo Matching

Stereo matching remains a fundamental challenge in computer vision. While deep learning-based methods have demonstrated superior accuracy, their computational demands limit their practicality. Conversely, traditional stereo algorithms offer efficiency but often fail to handle complex textures, occlusions, and illumination variations effectively. To address these limitations, this paper presents a hybrid framework that combines learned and handcrafted techniques for disparity estimation. This method leverages a CNN for discriminative feature extraction, which is then integrated with an enhanced Census Transform to compute a matching cost with improved invariance to radiometric variations. An Edge-Preserving Cost Aggregation (EPCA) module is introduced, which dynamically adjusts support regions based on local geometric structures to maintain depth discontinuities while suppressing noise. Post-Processing is done using a left-right check to further boost accuracy. Comprehensive evaluations on the Middlebury v3 benchmark demonstrate the framework's effectiveness, achieving competitive error rates of 8.48% (all pixels) and 5.03% (non-occluded regions). The proposed method performs well in textured regions while maintaining computational efficiency comparable to several other published methods. Results suggest that carefully designed hybrid systems can bridge the performance gap between learning and traditional methods, offering a balanced trade-off between accuracy and practicality.

Authors

Institutions

Publication Details

Published
2025-08-20
DOI
https://doi.org/10.1109/roma66616.2025.11155821
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Accurate 3D Depth Mapping for Robotic Vision Using Fused CNN and Edge-Preserving Cost Aggregation in Stereo Matching

Shamsul Fakhar Abd Gani, Rostam Affendi Hamzah, Tetiana Zaiko, Mohd Sharizal Abdul Aziz et al.
Advanced Vision and Imaging
article

Accurate 3D Depth Mapping for Robotic Vision Using Fused CNN and Edge-Preserving Cost Aggregation in Stereo Matching

Shamsul Fakhar Abd Gani, Rostam Affendi Hamzah, Tetiana Zaiko, Mohd Sharizal Abdul Aziz, Muhammad Fahmi Miskon, Siti Fairuz Pungot
article en

Abstract

Stereo matching remains a fundamental challenge in computer vision. While deep learning-based methods have demonstrated superior accuracy, their computational demands limit their practicality. Conversely, traditional stereo algorithms offer efficiency but often fail to handle complex textures, occlusions, and illumination variations effectively. To address these limitations, this paper presents a hybrid framework that combines learned and handcrafted techniques for disparity estimation. This method leverages a CNN for discriminative feature extraction, which is then integrated with an enhanced Census Transform to compute a matching cost with improved invariance to radiometric variations. An Edge-Preserving Cost Aggregation (EPCA) module is introduced, which dynamically adjusts support regions based on local geometric structures to maintain depth discontinuities while suppressing noise. Post-Processing is done using a left-right check to further boost accuracy. Comprehensive evaluations on the Middlebury v3 benchmark demonstrate the framework's effectiveness, achieving competitive error rates of 8.48% (all pixels) and 5.03% (non-occluded regions). The proposed method performs well in textured regions while maintaining computational efficiency comparable to several other published methods. Results suggest that carefully designed hybrid systems can bridge the performance gap between learning and traditional methods, offering a balanced trade-off between accuracy and practicality.

Universiti Sains Malaysia (MY), National University Zaporizhzhia Polytechnic (UA), Technical University of Malaysia Malacca (MY), Manipal University College Malaysia (MY)
Openalex Percentile: Top 76%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.