Multi-Source Information Fusion Navigation Based on Dynamic Attribute Scene Graphs

Scene understanding is crucial for autonomous navigation since it forms the interface between perception and planning. Effectively extracting and integrating information from a priori scene maps into the agent's observations for scene understanding is challenging. Traditional navigation methods rely on the policy network's capacity to implicitly encode such information and establish associations between them; however, the practical efficacy of these approaches is constrained. In contrast, the scene graph presents a higher-level representation of the environment, enabling explicit depiction of the semantic and geometric topological relationships present in the scene map. In this work, we propose a scene graph navigation framework using dynamic attribute scene graphs to enhance the agent's comprehension. The approach establishes connections between the scene graph and agent observations through attribute updates and utilizes graph neural networks for effective feature fusion. Experimental results demonstrate its effectiveness for UGV multi-target search tasks in diverse environments. Compared to the baselines, our method not only improves agent policy learning efficiency but also achieves more precise task completion. Additionally, we conducted experiments to verify the interpretability of the method.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1109/aiac63745.2024.10899632
Citations
1
Primary Topic
Geographic Information Systems Studies
Type
article
Field-Weighted Citation Impact
1.96
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Source Information Fusion Navigation Based on Dynamic Attribute Scene Graphs

Shaorong Xie, Jie Liu
1 citations
Geographic Information Systems Studies
1.96
article

Multi-Source Information Fusion Navigation Based on Dynamic Attribute Scene Graphs

Shaorong Xie, Jie Liu
article en
1 citations

Abstract

Scene understanding is crucial for autonomous navigation since it forms the interface between perception and planning. Effectively extracting and integrating information from a priori scene maps into the agent's observations for scene understanding is challenging. Traditional navigation methods rely on the policy network's capacity to implicitly encode such information and establish associations between them; however, the practical efficacy of these approaches is constrained. In contrast, the scene graph presents a higher-level representation of the environment, enabling explicit depiction of the semantic and geometric topological relationships present in the scene map. In this work, we propose a scene graph navigation framework using dynamic attribute scene graphs to enhance the agent's comprehension. The approach establishes connections between the scene graph and agent observations through attribute updates and utilizes graph neural networks for effective feature fusion. Experimental results demonstrate its effectiveness for UGV multi-target search tasks in diverse environments. Compared to the baselines, our method not only improves agent policy learning efficiency but also achieves more precise task completion. Additionally, we conducted experiments to verify the interpretability of the method.

Shanghai University of Engineering Science (CN)
Openalex Percentile: Top 9%
Geographic Information Systems Studies
1.96
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.