World model for robot learning: A comprehensive survey

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have advanced rapidly with the rise of foundation models and large-scale video generation. However, the literature remains fragmented across architectures, functional roles, and embodied application domains. To address this gap, we present a comprehensive review of world models from a robot-learning perspective. We examine how world models are coupled with robot policies, how they serve as learned simulators for reinforcement learning and evaluation, and how robotic video world models have progressed from imagination-based generation to controllable, structured, and foundation-scale formulations. We further summarize representative datasets, benchmarks, and evaluation protocols. Overall, this survey systematically reviews the rapidly growing literature on world models for robot learning, clarifies key paradigms and applications, and highlights major challenges and future directions for predictive modeling in embodied agents. To facilitate continued access to newly emerging works, benchmarks, and resources, we will maintain and regularly update the accompanying GitHub repository on https://github.com/NTUMARS/Awesome-World-Model-for-Robotics-Policy alongside this survey.

Authors

Institutions

Publication Details

Journal
The International Journal of Robotics Research
Published
2026-09-28
DOI
https://doi.org/10.1177/02783649261488980
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

World model for robot learning: A comprehensive survey

Jitendra Malik, Jindou Jia, Marc Pollefeys, Philip H. S. Torr et al.
The International Journal of Robotics Research
Reinforcement Learning in Robotics
article

World model for robot learning: A comprehensive survey

Jitendra Malik, Jindou Jia, Marc Pollefeys, Philip H. S. Torr, Pieter Abbeel, Sicong Leng, Oier Mees, Yanjie Ze, Bohan Hou, Tuo An, Tatsuya Harada, Haoran Geng, Jiajun Wu, Xinying Guo, Yilun Du, Gen K. Li, Zhuang Liu, Jianfei Yang
article en

Abstract

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have advanced rapidly with the rise of foundation models and large-scale video generation. However, the literature remains fragmented across architectures, functional roles, and embodied application domains. To address this gap, we present a comprehensive review of world models from a robot-learning perspective. We examine how world models are coupled with robot policies, how they serve as learned simulators for reinforcement learning and evaluation, and how robotic video world models have progressed from imagination-based generation to controllable, structured, and foundation-scale formulations. We further summarize representative datasets, benchmarks, and evaluation protocols. Overall, this survey systematically reviews the rapidly growing literature on world models for robot learning, clarifies key paradigms and applications, and highlights major challenges and future directions for predictive modeling in embodied agents. To facilitate continued access to newly emerging works, benchmarks, and resources, we will maintain and regularly update the accompanying GitHub repository on https://github.com/NTUMARS/Awesome-World-Model-for-Robotics-Policy alongside this survey.

The International Journal of Robotics Research
Harvard University (US), Nanyang Technological University (SG), Princeton University (US), ETH Zurich (CH), University of Oxford (GB), The University of Tokyo (JP), University of California, Berkeley (US), Stanford University (US)
Openalex Percentile: Top 64%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.