A survey of natural language interaction and environmental perception in intelligent robotics
Natural language interaction and physical environment understanding are two core challenges for improving the autonomy of home service robots. This paper provides a systematic review of the evolution from traditional robotic methods to embodied intelligence enabled by large language models (LLMs), vision-language models (VLMs), and vision-language-action (VLA) models. For environmental understanding, we review the transition from geometric maps to semantic representations and behavioral navigation, emphasizing the roles of semantic SLAM, hierarchical scene representations, and VLMs. For natural language interaction, we analyze the limitations of rule-based approaches and the advances enabled by LLMs in task planning, reasoning, and code generation. Unlike previous surveys focusing separately on perception or language interaction, this review establishes a unified taxonomy and analyzes representative LLM/VLM/VLA-based robotic systems. We further discuss emerging trends toward multimodal reasoning, language-guided action generation, and adaptive embodied intelligence, while identifying key challenges in generalization, real-time deployment, safety, and interpretability. Finally, future directions toward reliable and adaptive embodied robotic systems are discussed.
Authors
- Pengwei zhang
- 丁 娟 Ding Juan
- Xiaoqing Shao
- Qing Zhao
Institutions
- Xinjiang University of Science and Technology (CN)
- China National Petroleum Corporation (China) (CN)
Publication Details
- Journal
- Discover Applied Sciences
- Published
- 2026-11-19
- DOI
- https://doi.org/10.1007/s42452-026-09890-6
- Primary Topic
- Robot Manipulation and Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00