Multimodal embodied large models: unified perception-cognition-action architecture and applications

With the rapid development of artificial intelligence technology, embodied intelligence has emerged as one of the key pathways towards achieving artificial general intelligence. This paper provides an in-depth exploration of the design principles, technical challenges, and future directions of the unified perception-cognition-action architecture in multimodal embodied large models. We analyze the limitations of traditional modular architectures and propose a new architectural paradigm based on deep integration of perception, cognition, and action. This architecture achieves organic unification of perceptual information, cognitive reasoning, and executive control through end-to-end learning, providing a theoretical foundation for autonomous agent behavior in complex physical environments. This paper systematically examines the core technical elements of the perception-cognition-action architecture, including multimodal representation learning, cross-modal attention mechanisms, world model construction, and hierarchical decision-making frameworks. We also explore the application prospects of this architecture in intelligent manufacturing, service robotics, autonomous driving, and other domains. Finally, we analyze current technical challenges and provide perspectives on future development trends of embodied large models, offering new insights for advancing embodied intelligence research.

Authors

Publication Details

Journal
Scientia Sinica Informationis
Published
2026-02-01
DOI
https://doi.org/10.1360/ssi-2025-0238
Primary Topic
Action Observation and Synchronization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal embodied large models: unified perception-cognition-action architecture and applications

Fei WU, Yi YANG, Linchao ZHU
Scientia Sinica Informationis
Action Observation and Synchronization
article

Multimodal embodied large models: unified perception-cognition-action architecture and applications

Fei WU, Yi YANG, Linchao ZHU
article en

Abstract

With the rapid development of artificial intelligence technology, embodied intelligence has emerged as one of the key pathways towards achieving artificial general intelligence. This paper provides an in-depth exploration of the design principles, technical challenges, and future directions of the unified perception-cognition-action architecture in multimodal embodied large models. We analyze the limitations of traditional modular architectures and propose a new architectural paradigm based on deep integration of perception, cognition, and action. This architecture achieves organic unification of perceptual information, cognitive reasoning, and executive control through end-to-end learning, providing a theoretical foundation for autonomous agent behavior in complex physical environments. This paper systematically examines the core technical elements of the perception-cognition-action architecture, including multimodal representation learning, cross-modal attention mechanisms, world model construction, and hierarchical decision-making frameworks. We also explore the application prospects of this architecture in intelligent manufacturing, service robotics, autonomous driving, and other domains. Finally, we analyze current technical challenges and provide perspectives on future development trends of embodied large models, offering new insights for advancing embodied intelligence research.

Scientia Sinica InformationisVol. 56(2)
Openalex Percentile: Top 75%
Action Observation and Synchronization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.