Brain-inspired spatial intelligence for embodied agents
Spatial cognition enables adaptive goal-directed behavior through structured internal models of space. Robust biological systems consolidate spatial knowledge into three interconnected forms: landmarks for salient cues, route knowledge for movement trajectories, and survey knowledge for map-like representations. While recent advances in multi-modal large language models (MLLMs) have enabled visual-language reasoning in embodied agents, these efforts lack structured spatial memory and instead operate reactively, limiting their generalization and adaptability in complex real-world environments. Here we present Brain-inspired Spatial Cognition for Navigation (BSC-Nav), a unified framework for constructing and leveraging structured spatial memory in embodied agents. BSC-Nav builds allocentric cognitive maps from egocentric trajectories and contextual cues, and dynamically retrieves spatial knowledge aligned with semantic goals. Integrated with powerful MLLMs, BSC-Nav achieves state-of-the-art efficacy and efficiency across diverse embodied navigation tasks (e.g., improving success weighted by path length from 17.6% to 44.9% in instance-level navigation and from 42.7% to 53.1% in zero-shot long-horizon instruction-following), while also supporting versatile embodied behaviors in the real physical world. These results highlight a scalable path toward general-purpose spatial intelligence.
Authors
- Qihui Zhu (ORCID: https://orcid.org/0000-0003-2401-8443)
- Songming Liu (ORCID: https://orcid.org/0009-0002-4067-8089)
- Caixin Kang
- Shouwei Ruan (ORCID: https://orcid.org/0009-0007-0481-5855)
- Liyuan Wang (ORCID: https://orcid.org/0000-0002-3869-8155)
- Hang Su
- Xingxing Wei
Institutions
- Beijing Academy of Artificial Intelligence (CN)
- Beihang University (CN)
- Tsinghua University (CN)
Publication Details
- Journal
- Nature Communications
- Published
- 2026-06-27
- DOI
- https://doi.org/10.1038/s41467-026-74358-5
- Primary Topic
- EEG and Brain-Computer Interfaces
- Type
- article
- Field-Weighted Citation Impact
- 0.00