MH-FLOCKE: Biologically Grounded Embodied Cognition Through a 15-Step Closed-Loop Architecture for Quadruped Locomotion Learning

I present MH-FLOCKE, an embodied AI platform in which simulated quadruped creatures learn locomotion through a biologically grounded cognitive architecture. Unlike end-to-end reinforcement learning (RL) approaches that treat the body as an optimization target, MH-FLOCKE implements a 15-step closed-loop processing cycle that integrates proprioception, embodied emotions, episodic memory, motivational drives, a Global Workspace for attentional competition, metacognitiveself-assessment, and reward-modulated spike-timing-dependent plasticity (R-STDP) in a spiking neural network (SNN). In this revision, I address reviewer feedback by providing: (1) mathematical formulations of all core learning rules (Izhikevich dynamics, R-STDP, cerebellar forward model, competence gate), (2) a PPO baseline comparison showing MH-FLOCKE's neural learning coreachieves 3.5× the walking distance at equal 50k-step budget (45.15 ± 0.67 m vs. 12.83 ± 7.78 m; fixed-budget sample efficiency), (3) multi-seed statistical validation across 10 seeds and 80 runs, and (4) cross-embodiment transfer to the Unitree Go2 without architectural changes. Systematic ablation across 60+ runs isolates component contributions: vestibular reflexes eliminate all falls, motor babbling increases flat-terrain distance by 763%, the cerebellar forward model produces measurable prediction errors, and an olfactory sensory environment enables stimulus-driven behavior switching.The SNN+Cerebellum core (B1) achieves sigma = 0.67 m across 10 seeds — the lowest variance of any condition. I also report an interaction effect where the full cognitive architecture reduces locomotion distance compared to the neural core alone. Changelog: v2.0: Mathematical formulations expanded (reward function, SNN connectivity, dream mode), Section 2.5 added (comparison with prior SNN+CPG systems), cognitive efficiency metric, PCI clarification, language revision, Unicode rendering fixed.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-06-09
DOI
https://doi.org/10.5281/zenodo.20616889
Primary Topic
Action Observation and Synchronization
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

MH-FLOCKE: Biologically Grounded Embodied Cognition Through a 15-Step Closed-Loop Architecture for Quadruped Locomotion Learning

Marc Hesse
Zenodo (CERN European Organization for Nuclear Research)
Action Observation and Synchronization
preprint

MH-FLOCKE: Biologically Grounded Embodied Cognition Through a 15-Step Closed-Loop Architecture for Quadruped Locomotion Learning

Marc Hesse
preprint en

Abstract

I present MH-FLOCKE, an embodied AI platform in which simulated quadruped creatures learn locomotion through a biologically grounded cognitive architecture. Unlike end-to-end reinforcement learning (RL) approaches that treat the body as an optimization target, MH-FLOCKE implements a 15-step closed-loop processing cycle that integrates proprioception, embodied emotions, episodic memory, motivational drives, a Global Workspace for attentional competition, metacognitiveself-assessment, and reward-modulated spike-timing-dependent plasticity (R-STDP) in a spiking neural network (SNN). In this revision, I address reviewer feedback by providing: (1) mathematical formulations of all core learning rules (Izhikevich dynamics, R-STDP, cerebellar forward model, competence gate), (2) a PPO baseline comparison showing MH-FLOCKE's neural learning coreachieves 3.5× the walking distance at equal 50k-step budget (45.15 ± 0.67 m vs. 12.83 ± 7.78 m; fixed-budget sample efficiency), (3) multi-seed statistical validation across 10 seeds and 80 runs, and (4) cross-embodiment transfer to the Unitree Go2 without architectural changes. Systematic ablation across 60+ runs isolates component contributions: vestibular reflexes eliminate all falls, motor babbling increases flat-terrain distance by 763%, the cerebellar forward model produces measurable prediction errors, and an olfactory sensory environment enables stimulus-driven behavior switching.The SNN+Cerebellum core (B1) achieves sigma = 0.67 m across 10 seeds — the lowest variance of any condition. I also report an interaction effect where the full cognitive architecture reduces locomotion distance compared to the neural core alone. Changelog: v2.0: Mathematical formulations expanded (reward function, SNN connectivity, dream mode), Section 2.5 added (comparison with prior SNN+CPG systems), cognitive efficiency metric, PCI clarification, language revision, Unicode rendering fixed.

Zenodo (CERN European Organization for Nuclear Research)
Action Observation and Synchronization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.