ADDFNet: A Robotic Grasping Depth Map Completion Network Integrating Differential Enhancement Convolution and Hybrid Attention

In the field of industrial robotic vision, accurate recognition and localization of transparent objects pose significant challenges. Unlike opaque objects, transparent objects are difficult to distinguish in RGB images, and due to refraction and reflection, their depth information often suffers from large-area missing or erroneous values, leading to failed grasp pose prediction. Therefore, depth completion is crucial for transparent object grasping tasks. However, existing depth completion methods still exhibit obvious limitations. Multi-stage optimization methods, while achieving high accuracy, involve complex pipelines and high computational costs. Single-stage end-to-end networks, when processing sparse edge features of transparent objects that are also contaminated by background interference, are constrained by the receptive field and smoothing effect of conventional convolutions, often resulting in contour blurring and loss of geometric details. Moreover, existing methods still lack sufficient capability in modeling multi-directional gradient variations of transparent objects under complex backgrounds. To address these issues, this paper proposes ADDFNet for transparent object depth completion, achieving synergistic improvement in accuracy and robustness through two key designs: MDAM and CMFR. To tackle the problem of sparse edge features of transparent objects that are easily disturbed by noise, we design the Multi-directional Differential Attention Module (MDAM), which explicitly extracts multi-directional gradient information through multi-branch differential convolution. Within MDAM, we introduce the Detail Enhancement Differential sub-Module (DEDM) and the Dynamic Convolution with Symmetry-enhanced Geometry Attention sub-module (DSCA) to enhance the network’s perception of fine contours and improve global–local synergistic modeling capability. To address insufficient cross-modal information interaction, we introduce the Cross-Modal Feature Refinement (CMFR) module, which utilizes RGB context to guide and enhance depth features layer by layer during the encoding stage, improving the accuracy and robustness of depth completion while mitigating feature degradation caused by traditional simple fusion approaches. Experimental results on the ClearPose and TransCG datasets demonstrate that ADDFNet outperforms comparison methods in terms of RMSE, REL, MAE, and threshold accuracy metrics, exhibiting more stable performance in edge recovery and internal detail reconstruction of transparent objects.

Authors

Institutions

Publication Details

Journal
Actuators
Published
2026-05-22
DOI
https://doi.org/10.3390/act15060280
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ADDFNet: A Robotic Grasping Depth Map Completion Network Integrating Differential Enhancement Convolution and Hybrid Attention

Jiaen Wang, Yue Wu, Xian Yu, Yi-Horng Lai et al.
Actuators
Robot Manipulation and Learning
article

ADDFNet: A Robotic Grasping Depth Map Completion Network Integrating Differential Enhancement Convolution and Hybrid Attention

Jiaen Wang, Yue Wu, Xian Yu, Yi-Horng Lai, Nan Liu
article en

Abstract

In the field of industrial robotic vision, accurate recognition and localization of transparent objects pose significant challenges. Unlike opaque objects, transparent objects are difficult to distinguish in RGB images, and due to refraction and reflection, their depth information often suffers from large-area missing or erroneous values, leading to failed grasp pose prediction. Therefore, depth completion is crucial for transparent object grasping tasks. However, existing depth completion methods still exhibit obvious limitations. Multi-stage optimization methods, while achieving high accuracy, involve complex pipelines and high computational costs. Single-stage end-to-end networks, when processing sparse edge features of transparent objects that are also contaminated by background interference, are constrained by the receptive field and smoothing effect of conventional convolutions, often resulting in contour blurring and loss of geometric details. Moreover, existing methods still lack sufficient capability in modeling multi-directional gradient variations of transparent objects under complex backgrounds. To address these issues, this paper proposes ADDFNet for transparent object depth completion, achieving synergistic improvement in accuracy and robustness through two key designs: MDAM and CMFR. To tackle the problem of sparse edge features of transparent objects that are easily disturbed by noise, we design the Multi-directional Differential Attention Module (MDAM), which explicitly extracts multi-directional gradient information through multi-branch differential convolution. Within MDAM, we introduce the Detail Enhancement Differential sub-Module (DEDM) and the Dynamic Convolution with Symmetry-enhanced Geometry Attention sub-module (DSCA) to enhance the network’s perception of fine contours and improve global–local synergistic modeling capability. To address insufficient cross-modal information interaction, we introduce the Cross-Modal Feature Refinement (CMFR) module, which utilizes RGB context to guide and enhance depth features layer by layer during the encoding stage, improving the accuracy and robustness of depth completion while mitigating feature degradation caused by traditional simple fusion approaches. Experimental results on the ClearPose and TransCG datasets demonstrate that ADDFNet outperforms comparison methods in terms of RMSE, REL, MAE, and threshold accuracy metrics, exhibiting more stable performance in edge recovery and internal detail reconstruction of transparent objects.

ActuatorsVol. 15(6)
Xiamen University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 5%
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.