FALCON-HiMRAN: A Dual-stage RGB–D Sensor–based Scene Classification Framework with Cross-modal Fusion and Graph Reasoning

In this study, we address key limitations in RGB-depth (D) sensing systems, including depth noise, sensor misalignment, missing depth values, and performance degradation under low illumination.We propose a dual-stage RGB-D sensor-driven scene classification framework comprising feature-aligned lightweight cross-modal fusion (FALCON) and a hierarchical multiregion aggregation network (HiMRAN), the FALCON-HiMRAN, designed to enhance the reliability and interpretability of multimodal sensing systems.The proposed method integrates the data acquired from structured-light and time-of-flight RGB-D sensors and introduces the FALCON network to mitigate modality inconsistencies and sensor-induced noise.Furthermore, HiMRAN was developed to perform region-level reasoning by the graph-based modeling of spatial relationships.Experimental evaluation on benchmark RGB-D datasets demonstrates improved robustness under challenging sensing conditions such as occlusion, illumination variation, and depth degradation.The proposed framework contributes to the advancement of sensor-based perception systems by enabling more reliable scene understanding from imperfect multimodal sensor data.Remaining challenges include real-time deployment and the handling of extreme sensor noise in outdoor environments.

Authors

Publication Details

Journal
Sensors and Materials
Published
2026-05-11
DOI
https://doi.org/10.18494/sam5949
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

FALCON-HiMRAN: A Dual-stage RGB–D Sensor–based Scene Classification Framework with Cross-modal Fusion and Graph Reasoning

Nouf Abdullah Almujally, Ting Wu, Hui Liu, Muhammad Waqas Ahmed et al.
Sensors and Materials
Advanced Neural Network Applications
article

FALCON-HiMRAN: A Dual-stage RGB–D Sensor–based Scene Classification Framework with Cross-modal Fusion and Graph Reasoning

Nouf Abdullah Almujally, Ting Wu, Hui Liu, Muhammad Waqas Ahmed, Ahmad Jalal
article en

Abstract

In this study, we address key limitations in RGB-depth (D) sensing systems, including depth noise, sensor misalignment, missing depth values, and performance degradation under low illumination.We propose a dual-stage RGB-D sensor-driven scene classification framework comprising feature-aligned lightweight cross-modal fusion (FALCON) and a hierarchical multiregion aggregation network (HiMRAN), the FALCON-HiMRAN, designed to enhance the reliability and interpretability of multimodal sensing systems.The proposed method integrates the data acquired from structured-light and time-of-flight RGB-D sensors and introduces the FALCON network to mitigate modality inconsistencies and sensor-induced noise.Furthermore, HiMRAN was developed to perform region-level reasoning by the graph-based modeling of spatial relationships.Experimental evaluation on benchmark RGB-D datasets demonstrates improved robustness under challenging sensing conditions such as occlusion, illumination variation, and depth degradation.The proposed framework contributes to the advancement of sensor-based perception systems by enabling more reliable scene understanding from imperfect multimodal sensor data.Remaining challenges include real-time deployment and the handling of extreme sensor noise in outdoor environments.

Sensors and MaterialsVol. 38(5)
Deutsche Forschungsgemeinschaft, Princess Nourah Bint Abdulrahman University, Universität Bremen
Openalex Percentile: Top 5%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.