Separating Routing Organization from Task Success: Matched Evidence from Prototype-Routed MoE Policies

Mixture-of-experts (MoE) policies can represent the different control regimes within a manipulation task. However, their routing partitions are usually learned without using the kinematic structure from the demonstrations. Therefore, we study whether trajectory-derived kinematic regimes can serve as an initialisation prior, obtained by segmenting and clustering the demonstrations. Stage 1 is trained with action prediction and rule-derived phase supervision. Regime-conditioned centroids of the Stage 1 latent representation then initialise hard-routing prototypes before joint fine-tuning. A matched prototype-routing ablation compares trajectory-derived, random, and rule-based prototype initialisation. Phase-expert alignment (NMI) and routing-switch rate are measured on validation demonstrations, separately from closed-loop rollout success. A learned softmax gate serves as an architectural diagnostic. Trajectory-derived initialisation yields higher mean final NMI (0.67 on Can; 0.51 on Square) than random and rule-based initialisation (0.07–0.09), with lower mean routing-switch rates (0.04–0.07 versus 0.10–0.11). Pooled rollout success is 76.0% on Can, compared with 73.3% and 68.7% for random and rule-based initialisation, and 26.7% on Square, compared with 28.0% and 31.3%. Under matched conditions, trajectory-derived initialisation produces distinct offline routing partitions, but closed-loop success differences across three independently trained seeds are not statistically resolved after Holm adjustment.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-26
DOI
https://doi.org/10.5281/zenodo.23659692
Primary Topic
Reinforcement Learning in Robotics
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Separating Routing Organization from Task Success: Matched Evidence from Prototype-Routed MoE Policies

Krishna Subedi
Zenodo (CERN European Organization for Nuclear Research)
Reinforcement Learning in Robotics
preprint

Separating Routing Organization from Task Success: Matched Evidence from Prototype-Routed MoE Policies

Krishna Subedi
preprint en

Abstract

Mixture-of-experts (MoE) policies can represent the different control regimes within a manipulation task. However, their routing partitions are usually learned without using the kinematic structure from the demonstrations. Therefore, we study whether trajectory-derived kinematic regimes can serve as an initialisation prior, obtained by segmenting and clustering the demonstrations. Stage 1 is trained with action prediction and rule-derived phase supervision. Regime-conditioned centroids of the Stage 1 latent representation then initialise hard-routing prototypes before joint fine-tuning. A matched prototype-routing ablation compares trajectory-derived, random, and rule-based prototype initialisation. Phase-expert alignment (NMI) and routing-switch rate are measured on validation demonstrations, separately from closed-loop rollout success. A learned softmax gate serves as an architectural diagnostic. Trajectory-derived initialisation yields higher mean final NMI (0.67 on Can; 0.51 on Square) than random and rule-based initialisation (0.07–0.09), with lower mean routing-switch rates (0.04–0.07 versus 0.10–0.11). Pooled rollout success is 76.0% on Can, compared with 73.3% and 68.7% for random and rule-based initialisation, and 26.7% on Square, compared with 28.0% and 31.3%. Under matched conditions, trajectory-derived initialisation produces distinct offline routing partitions, but closed-loop success differences across three independently trained seeds are not statistically resolved after Holm adjustment.

Zenodo (CERN European Organization for Nuclear Research)
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon