ContextNav: context-aware navigation through online two-stage exploration with scene graph reasoning
Goal-oriented navigation requires an embodied agent to reach a target specified by visual or textual input, integrating perception, spatial reasoning, and decision-making. However, existing methods typically rely on object labels or evaluate relationships between object pairs independently, limiting their ability to capture the overall relational context. We propose Context-Aware Navigation (ContextNav), which models goal verification as a graph-level similarity estimation problem. This enables the agent to determine whether its current observation matches a target goal represented as a scene graph by capturing structure-aware relational dependencies. Unlike previous methods that decompose scene graphs into independent subject-predicate-object triplets, our approach captures dependencies across interconnected relations in the full scene graph. ContextNav includes a Graph-Structured Similarity Estimation (GSSE) module that verifies goal satisfaction by comparing goal and observation graphs generated via VLM-based scene graph generation. It also employs an Online Two-Stage Exploration (OTSE) strategy, which first identifies candidate rooms, computes a minimum-cost inter-room route to the selected candidate under the current room graph, and then performs local goal exploration. Thus, the room-level route is optimal with respect to the current graph and traversal costs, although the complete goal-oriented trajectory is not guaranteed to be globally path-optimal. To evaluate goals specified by explicit object-relation structures, we formulate GraphNav as a structured-goal setting within goal-oriented navigation and introduce ProcTHOR-10K-Context, which extends ProcTHOR-10K with object-context graph annotations. We evaluate ContextNav on four goal modalities: object-, image-, text-, and graph-guided navigation, using HM3D, RoboTHOR, ProcTHOR, and our proposed ProcTHOR-10K-Context, showing consistent gains, particularly on context-rich graph-guided navigation.
Authors
- Itthisak Phueaksri (ORCID: https://orcid.org/0000-0002-1295-777X)
- Kawanishi Yasutomo
Institutions
- Ritsumeikan University (JP)
- RIKEN (JP)
Publication Details
- Journal
- Advanced Robotics
- Published
- 2026-11-16
- DOI
- https://doi.org/10.1080/01691864.2026.2753287
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Japan Society for the Promotion of Science