A survey of natural language interaction and environmental perception in intelligent robotics

Natural language interaction and physical environment understanding are two core challenges for improving the autonomy of home service robots. This paper provides a systematic review of the evolution from traditional robotic methods to embodied intelligence enabled by large language models (LLMs), vision-language models (VLMs), and vision-language-action (VLA) models. For environmental understanding, we review the transition from geometric maps to semantic representations and behavioral navigation, emphasizing the roles of semantic SLAM, hierarchical scene representations, and VLMs. For natural language interaction, we analyze the limitations of rule-based approaches and the advances enabled by LLMs in task planning, reasoning, and code generation. Unlike previous surveys focusing separately on perception or language interaction, this review establishes a unified taxonomy and analyzes representative LLM/VLM/VLA-based robotic systems. We further discuss emerging trends toward multimodal reasoning, language-guided action generation, and adaptive embodied intelligence, while identifying key challenges in generalization, real-time deployment, safety, and interpretability. Finally, future directions toward reliable and adaptive embodied robotic systems are discussed.

Authors

Institutions

Publication Details

Journal
Discover Applied Sciences
Published
2026-11-19
DOI
https://doi.org/10.1007/s42452-026-09890-6
Primary Topic
Robot Manipulation and Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A survey of natural language interaction and environmental perception in intelligent robotics

Pengwei zhang, 丁 娟 Ding Juan, Xiaoqing Shao, Qing Zhao
Discover Applied Sciences
Robot Manipulation and Learning
article

A survey of natural language interaction and environmental perception in intelligent robotics

Pengwei zhang, 丁 娟 Ding Juan, Xiaoqing Shao, Qing Zhao
article en

Abstract

Natural language interaction and physical environment understanding are two core challenges for improving the autonomy of home service robots. This paper provides a systematic review of the evolution from traditional robotic methods to embodied intelligence enabled by large language models (LLMs), vision-language models (VLMs), and vision-language-action (VLA) models. For environmental understanding, we review the transition from geometric maps to semantic representations and behavioral navigation, emphasizing the roles of semantic SLAM, hierarchical scene representations, and VLMs. For natural language interaction, we analyze the limitations of rule-based approaches and the advances enabled by LLMs in task planning, reasoning, and code generation. Unlike previous surveys focusing separately on perception or language interaction, this review establishes a unified taxonomy and analyzes representative LLM/VLM/VLA-based robotic systems. We further discuss emerging trends toward multimodal reasoning, language-guided action generation, and adaptive embodied intelligence, while identifying key challenges in generalization, real-time deployment, safety, and interpretability. Finally, future directions toward reliable and adaptive embodied robotic systems are discussed.

Discover Applied Sciences
Xinjiang University of Science and Technology (CN), China National Petroleum Corporation (China) (CN)
Robot Manipulation and Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon