Predictive processing as a scalable computational principle for embodied multitask intelligence
Humans exhibit remarkable flexibility in adapting to diverse and uncertain environments-a hallmark arising from the brain's ability to integrate multimodal sensory streams into coherent predictive models. Drawing on this principle, we introduce a scalable hierarchical multimodal recurrent neural network grounded in predictive processing under the free-energy principle, capable of directly integrating more than 30,000-dimensional visuo-proprioceptive inputs without dimensionality reduction or handcrafted preprocessing. Using sensory data from teleoperation of a full-scale physical humanoid robot performing two caregiving-related tasks-rigid-body repositioning and flexible-towel wiping-the model learns to predict high-dimensional visuo-proprioceptive streams end to end. In open-loop adaptive inference experiments, the framework exhibits three emergent properties: (i) self-organized hierarchical latent dynamics governing task transitions, uncertainty, and occlusion inference; (ii) robustness to degraded vision via multimodal integration; and (iii) asymmetric interference in multitask learning. Although evaluated in simulations, the framework is extensible to closed-loop robot control, with proprioceptive predictions driving action, thereby establishing a generalizable computational foundation bridging brain theory, artificial intelligence, and embodied robotics.
Authors
- Yuichi Yamashita (ORCID: https://orcid.org/0000-0002-2779-8222)
- Hayato Idei (ORCID: https://orcid.org/0000-0003-3368-2901)
- Tetsuya Ogata
- Tamon Miyake
Institutions
- Waseda University (JP)
- National Center of Neurology and Psychiatry (JP)
Publication Details
- Journal
- Science Advances
- Published
- 2026-08-14
- DOI
- https://doi.org/10.1126/sciadv.aed7511
- Primary Topic
- Action Observation and Synchronization
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Center of Neurology and Psychiatry
- Japan Society for the Promotion of Science
- Core Research for Evolutional Science and Technology