Bias-Free Semi-Supervised 3D Reconstruction via Occlusion Sensitivity-Guided Semantic Disentanglement

3D reconstruction faces challenges such as geometric warping and structural ambiguity, particularly in intricate topologies, heavy occlusions and complex backgrounds. These problems are partly attributed to excessive feature entanglement, which induces semantic confusion and spatial ambiguity. To address these limitations, we propose an occlusion sensitivity-guided semantic-disentangled Mamba-CNN network that enables human-controllable disentanglement of multi-attribute information within a bias-free semi-supervised framework. Specifically, we create various occlusion conditions and assign pseudo-labels to the augmented data within a semi-supervised framework, which enables the exploration of occlusion sensitivity of different semantic attributes for human-controllable semantic disentanglement. To reduce the bias between the augmented samples and their assigned pseudo-labels, we use linear PIoU and nonlinear MS-SSIM algorithms to calculate the confidence of pseudo-labels, which minimizes the error propagation caused by the bias. Then, we develop a disentangled multi-depth Mamba-CNN block that combines CNN’s local feature extraction capability with Mamba’s ability to capture long-range dependencies. This allows our model to effectively capture disentangled multi-attribute spatial features and semantic representations. However, critical cross-level semantic attribute connections could be lost in the disentanglement process. To tackle this, we propose a multi-attribute semantic query block to dynamically re-establish these connections and minimize cross-attribute information loss. Extensive quantitative and qualitative evaluations on object and face reconstruction demonstrate that our method outperforms existing state-of-the-art approaches. Codes and all resources will be publicly available on GitHub.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Multimedia Computing Communications and Applications
Published
2026-02-23
DOI
https://doi.org/10.1145/3796709
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Bias-Free Semi-Supervised 3D Reconstruction via Occlusion Sensitivity-Guided Semantic Disentanglement

Jianjun Wang, Fuqiang Liu, Lei Li
ACM Transactions on Multimedia Computing Communications and Applications
Face recognition and analysis
article

Bias-Free Semi-Supervised 3D Reconstruction via Occlusion Sensitivity-Guided Semantic Disentanglement

Jianjun Wang, Fuqiang Liu, Lei Li
article en

Abstract

3D reconstruction faces challenges such as geometric warping and structural ambiguity, particularly in intricate topologies, heavy occlusions and complex backgrounds. These problems are partly attributed to excessive feature entanglement, which induces semantic confusion and spatial ambiguity. To address these limitations, we propose an occlusion sensitivity-guided semantic-disentangled Mamba-CNN network that enables human-controllable disentanglement of multi-attribute information within a bias-free semi-supervised framework. Specifically, we create various occlusion conditions and assign pseudo-labels to the augmented data within a semi-supervised framework, which enables the exploration of occlusion sensitivity of different semantic attributes for human-controllable semantic disentanglement. To reduce the bias between the augmented samples and their assigned pseudo-labels, we use linear PIoU and nonlinear MS-SSIM algorithms to calculate the confidence of pseudo-labels, which minimizes the error propagation caused by the bias. Then, we develop a disentangled multi-depth Mamba-CNN block that combines CNN’s local feature extraction capability with Mamba’s ability to capture long-range dependencies. This allows our model to effectively capture disentangled multi-attribute spatial features and semantic representations. However, critical cross-level semantic attribute connections could be lost in the disentanglement process. To tackle this, we propose a multi-attribute semantic query block to dynamically re-establish these connections and minimize cross-attribute information loss. Extensive quantitative and qualitative evaluations on object and face reconstruction demonstrate that our method outperforms existing state-of-the-art approaches. Codes and all resources will be publicly available on GitHub.

ACM Transactions on Multimedia Computing Communications and Applications
Tongji University (CN), Fudan University (CN)
Reduced inequalities
Openalex Percentile: Top 49%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.