A Geometry-Controlled Analysis of Semantic Collapse and Recoverability in a Query-Based BEV 3D Detector

Camera-only BEV 3D object detectors are trained under highly imbalanced category distributions, and their matched object queries can exhibit directional semantic errors toward frequent classes. We investigate this behavior as a diagnostic problem: given fixed geometric predictions and fixed query–ground-truth assignments, how much class information remains accessible in frozen decoder features, which errors can be recovered, and where does recovery fail? We establish a scene-disjoint protocol in which recovery fitting and model selection use separate subsets of the official nuScenes training set, while all 150 validation scenes (6019 samples) remain final-only until all model and post-processing choices are fixed. Geometry-only Hungarian matching produces 158,253 fixed positive pairs on the full validation set. The frozen detector obtains a macro accuracy of 0.6136 on these pairs, while a lightweight factorized head trained on frozen features from decoder layer 4 reaches 0.6959 ± 0.0012 across three seeds. A linear probe achieves a macro accuracy of 0.8628 on the internal tuning split, whereas a shuffled-label control remains at chance (0.1000), indicating that substantial class information remains decodable from the frozen features. Tail-focused analysis further shows that recovered errors are more separable in frozen feature space than unrecovered errors across all 15 class-by-seed comparisons. However, recovery is not consistently observed across the controlled ResNet-18 and ResNet-50 configurations, and locked end-to-end evaluation decreases mAP from 0.2565 to 0.1620 and NDS from 0.3582 to 0.2796. These results support a geometry-controlled diagnosis of partial and class-dependent semantic recoverability, rather than improved localization, architecture-independent recovery, or deployable detection performance.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-09-10
DOI
https://doi.org/10.3390/app16188977
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

A Geometry-Controlled Analysis of Semantic Collapse and Recoverability in a Query-Based BEV 3D Detector

Yong-Geun Hong, Seongbok Baik, DeokHyun You
Applied Sciences
Advanced Neural Network Applications
article

A Geometry-Controlled Analysis of Semantic Collapse and Recoverability in a Query-Based BEV 3D Detector

Yong-Geun Hong, Seongbok Baik, DeokHyun You
article en

Abstract

Camera-only BEV 3D object detectors are trained under highly imbalanced category distributions, and their matched object queries can exhibit directional semantic errors toward frequent classes. We investigate this behavior as a diagnostic problem: given fixed geometric predictions and fixed query–ground-truth assignments, how much class information remains accessible in frozen decoder features, which errors can be recovered, and where does recovery fail? We establish a scene-disjoint protocol in which recovery fitting and model selection use separate subsets of the official nuScenes training set, while all 150 validation scenes (6019 samples) remain final-only until all model and post-processing choices are fixed. Geometry-only Hungarian matching produces 158,253 fixed positive pairs on the full validation set. The frozen detector obtains a macro accuracy of 0.6136 on these pairs, while a lightweight factorized head trained on frozen features from decoder layer 4 reaches 0.6959 ± 0.0012 across three seeds. A linear probe achieves a macro accuracy of 0.8628 on the internal tuning split, whereas a shuffled-label control remains at chance (0.1000), indicating that substantial class information remains decodable from the frozen features. Tail-focused analysis further shows that recovered errors are more separable in frozen feature space than unrecovered errors across all 15 class-by-seed comparisons. However, recovery is not consistently observed across the controlled ResNet-18 and ResNet-50 configurations, and locked end-to-end evaluation decreases mAP from 0.2565 to 0.1620 and NDS from 0.3582 to 0.2796. These results support a geometry-controlled diagnosis of partial and class-dependent semantic recoverability, rather than improved localization, architecture-independent recovery, or deployable detection performance.

Applied SciencesVol. 16(18)
Daejeon University (KR)
Openalex Percentile: Top 13%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Geometry-Controlled Analysis of Semantic Collapse and Recoverability in a Query-Based BEV 3D Detector — Yong-Geun Hong, Seongbok Baik, et al. · Applied Sciences (2026) | TGRS Research Map | TGRS