General Planning Method for Humanoid Collaborative Robots Using Large Language Models

Humanoid robots, capable of simulating human behavior and decision-making, have garnered extensive attention due to their anthropomorphic structures and versatile functional designs. Traditionally, actions and high-level decision-making in robots have been manually achieved by developers, requiring modifications and adaptations for different task requirements, thus lacking autonomous decision-making capabilities. With the rapid advancement of deep learning technologies, large language models trained on internet data have provided new solutions for robot intelligence, demonstrating effective applications in high-level task planning for robots. Based on this, we propose a general high-level task planning method using large language models, implemented on a mobile single-arm humanoid robot as the platform. This method consists of two core components: high-level decision planning and low-level action execution, coupled through the robot's atomic action interface. The robot autonomously completes sequential action planning by receiving natural language task instructions and executes long-term, complex, general indoor collaborative tasks. By deploying on a real robot, we conducted sub-module tests and overall system performance tests, successfully achieving the process of sorting and organizing tasks in an indoor experimental environment.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/cac63892.2024.10865732
Primary Topic
Robotics and Automated Systems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

General Planning Method for Humanoid Collaborative Robots Using Large Language Models

Jiamin Shi, Shu Tian, Robert X. Gao, Shitao Chen
Robotics and Automated Systems
article

General Planning Method for Humanoid Collaborative Robots Using Large Language Models

Jiamin Shi, Shu Tian, Robert X. Gao, Shitao Chen
article en

Abstract

Humanoid robots, capable of simulating human behavior and decision-making, have garnered extensive attention due to their anthropomorphic structures and versatile functional designs. Traditionally, actions and high-level decision-making in robots have been manually achieved by developers, requiring modifications and adaptations for different task requirements, thus lacking autonomous decision-making capabilities. With the rapid advancement of deep learning technologies, large language models trained on internet data have provided new solutions for robot intelligence, demonstrating effective applications in high-level task planning for robots. Based on this, we propose a general high-level task planning method using large language models, implemented on a mobile single-arm humanoid robot as the platform. This method consists of two core components: high-level decision planning and low-level action execution, coupled through the robot's atomic action interface. The robot autonomously completes sequential action planning by receiving natural language task instructions and executes long-term, complex, general indoor collaborative tasks. By deploying on a real robot, we conducted sub-module tests and overall system performance tests, successfully achieving the process of sorting and organizing tasks in an indoor experimental environment.

Xi'an Jiaotong University (CN)
National Natural Science Foundation of China
Sustainable cities and communities
Openalex Percentile: Top 66%
Robotics and Automated Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

General Planning Method for Humanoid Collaborative Robots Using Large Language Models — Jiamin Shi, Shu Tian, et al. · (2024) | TGRS Research Map | TGRS