Cross-modal semantic scene completion for complex urban traffic scenes with reachability geometric attention

In complex urban roads, mutual occlusions among multiple entities are pervasive. Approaches that rely solely on visible-appearance segmentation or perform completion only in voxel space struggle to recover pixel-level semantics and shapes for occluded regions. This paper presents AGAC, a cross-modal, temporally aware semantic scene completion network augmented with reachability-aware geometric attention. We first construct an anisotropic reachability potential field in a unified reference frame and differentiably project both the potential values and the steepest-descent directions onto the image plane, yielding per-pixel reachability scalars, preferred propagation directions, and reachability masks. We then introduce reachability-aware geometric attention in the pixel domain, embedding potential differences, directional consistency, and occlusion risk into both the attention neighborhood and its scoring, so that long-range completion propagates only along geometrically feasible, low-cost, and directionally consistent conduits. The decoder performs hierarchical occlusion parsing with anisotropic refinement, diffusing along the principal direction while suppressing boundary leakage along the normal, thereby achieving amodal filling with continuous contours and topologically consistent shapes. Finally, a geometry-reprojection-gated dual-window memory with uncertainty weighting delivers temporally stable cross-frame fusion and robust reliability quantification on hard cases. System-level evaluations on KITTI-360-APS, BDD100K-APS, and BlendPASS show that AGAC achieves leading performance on APQ, APC, AAP, and occluded-instance AP_occ, improving overall metrics by approximately 3-4% over strong baselines and AP_occ by about 5-7%. Gains are more pronounced under heavy occlusion, large scale, and long range, while quality in visible regions remains stably unimpaired.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-21
DOI
https://doi.org/10.1038/s41598-026-53833-5
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-modal semantic scene completion for complex urban traffic scenes with reachability geometric attention

Xichang Yu, Meixia Dong, Shaojiang Liu, Jiajun Zou et al.
Scientific Reports
Advanced Neural Network Applications
article

Cross-modal semantic scene completion for complex urban traffic scenes with reachability geometric attention

Xichang Yu, Meixia Dong, Shaojiang Liu, Jiajun Zou, Baorong Zhan, Feng Wang
article en

Abstract

In complex urban roads, mutual occlusions among multiple entities are pervasive. Approaches that rely solely on visible-appearance segmentation or perform completion only in voxel space struggle to recover pixel-level semantics and shapes for occluded regions. This paper presents AGAC, a cross-modal, temporally aware semantic scene completion network augmented with reachability-aware geometric attention. We first construct an anisotropic reachability potential field in a unified reference frame and differentiably project both the potential values and the steepest-descent directions onto the image plane, yielding per-pixel reachability scalars, preferred propagation directions, and reachability masks. We then introduce reachability-aware geometric attention in the pixel domain, embedding potential differences, directional consistency, and occlusion risk into both the attention neighborhood and its scoring, so that long-range completion propagates only along geometrically feasible, low-cost, and directionally consistent conduits. The decoder performs hierarchical occlusion parsing with anisotropic refinement, diffusing along the principal direction while suppressing boundary leakage along the normal, thereby achieving amodal filling with continuous contours and topologically consistent shapes. Finally, a geometry-reprojection-gated dual-window memory with uncertainty weighting delivers temporally stable cross-frame fusion and robust reliability quantification on hard cases. System-level evaluations on KITTI-360-APS, BDD100K-APS, and BlendPASS show that AGAC achieves leading performance on APQ, APC, AAP, and occluded-instance AP_occ, improving overall metrics by approximately 3-4% over strong baselines and AP_occ by about 5-7%. Gains are more pronounced under heavy occlusion, large scale, and long range, while quality in visible regions remains stably unimpaired.

Scientific Reports
China Mobile (China) (CN), XTC (China) (CN), Anhui Xinhua University (CN)
Sustainable cities and communities
Openalex Percentile: Top 4%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.