Embodied artificial cognition: evaluating self-awareness in multimodal large language models with robotic sensory integration

Self-Awareness --- the capacity of an individual to represent and understand itself as the subject of experience and action --- is sustained as the foundation of intelligence and autonomous behavior. The most recent advances in AI have reached human-like performance in tasks that integrate multimodal information, especially in large language models (LLMs), which has raised interest in the embodiment capabilities of AI agents in non-human platforms such as robots. For centuries, different fields of study, from philosophy to neuroscience, have devoted significant efforts to the definition and characterization of Self-Awareness. In the present study, the capabilities of a LLM to develop Self-Awareness are analyzed when embedded in an autonomous mobile robot, relying solely on sensorimotor experience. By integrating a multimodal LLM into an autonomous mobile robot, we test its capacity to achieve artificial Self-Awareness. We find that the system demonstrates solid environmental awareness, self-recognition, and predictive awareness, which allows it to infer its robotic nature and movement characteristics. Structural Equation Modeling (SEM) reveals how sensory integration influences different dimensions of Self-Awareness and its coordination with past–present memory, as well as the hierarchical internal associations that drive self-identification. Moreover, through SEM we identify similarities between the cognitive constructs developed by the system and the human brain structures responsible for Self-Awareness. Ablation tests of sensory inputs identify critical modalities for each dimension, demonstrate compensatory interactions between sensors, and confirm the essential role of structured episodic memory in coherent reasoning. These findings show that, given adequate sensory information about the world and itself, multimodal LLMs exhibit emergent Self-Awareness, opening the door to embodied artificial cognitive systems.

Publication Details

Journal
UPM Digital Archive (Technical University of Madrid)
Published
2025-09-23
Primary Topic
Social Robot Interaction and HRI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Embodied artificial cognition: evaluating self-awareness in multimodal large language models with robotic sensory integration

UPM Digital Archive (Technical University of Madrid)
Social Robot Interaction and HRI
article

Embodied artificial cognition: evaluating self-awareness in multimodal large language models with robotic sensory integration

article en

Abstract

Self-Awareness --- the capacity of an individual to represent and understand itself as the subject of experience and action --- is sustained as the foundation of intelligence and autonomous behavior. The most recent advances in AI have reached human-like performance in tasks that integrate multimodal information, especially in large language models (LLMs), which has raised interest in the embodiment capabilities of AI agents in non-human platforms such as robots. For centuries, different fields of study, from philosophy to neuroscience, have devoted significant efforts to the definition and characterization of Self-Awareness. In the present study, the capabilities of a LLM to develop Self-Awareness are analyzed when embedded in an autonomous mobile robot, relying solely on sensorimotor experience. By integrating a multimodal LLM into an autonomous mobile robot, we test its capacity to achieve artificial Self-Awareness. We find that the system demonstrates solid environmental awareness, self-recognition, and predictive awareness, which allows it to infer its robotic nature and movement characteristics. Structural Equation Modeling (SEM) reveals how sensory integration influences different dimensions of Self-Awareness and its coordination with past–present memory, as well as the hierarchical internal associations that drive self-identification. Moreover, through SEM we identify similarities between the cognitive constructs developed by the system and the human brain structures responsible for Self-Awareness. Ablation tests of sensory inputs identify critical modalities for each dimension, demonstrate compensatory interactions between sensors, and confirm the essential role of structured episodic memory in coherent reasoning. These findings show that, given adequate sensory information about the world and itself, multimodal LLMs exhibit emergent Self-Awareness, opening the door to embodied artificial cognitive systems.

UPM Digital Archive (Technical University of Madrid)
Quality Education
Openalex Percentile: Top 32%
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.