H2O Dormant Memory: Preregistered Synthetic Evaluations and a Failed Context-Selection Non-Inferiority Test for LLM Agent Swarms

H2O Dormant Memory is a falsifiable prototype that keeps provenance-bearing memory units outside an active working set until typed cues reactivate a bounded subset. Six preregistered studies evaluated the approach using synthetic or repository-derived data. Early controlled tests reduced active candidates and prompt bytes while preserving quality. The final document-transformation comparison, however, failed its preregistered non-inferiority condition: submitted prompt bytes fell from 41,232 to 5,506, but quality fell from 10/12 to 6/12 because the selector omitted critical numerical evidence and a measurement-status marker. Actual billed tokens, monetary cost, provider-side memory, and energy were not measured. The result is reported as a negative finding and a design requirement for evidence-complete, reversible context selection.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-09-05
DOI
https://doi.org/10.5281/zenodo.22316248
Primary Topic
Scientific Computing and Data Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

H2O Dormant Memory: Preregistered Synthetic Evaluations and a Failed Context-Selection Non-Inferiority Test for LLM Agent Swarms

Ryoko Sakakibara
Zenodo (CERN European Organization for Nuclear Research)
Scientific Computing and Data Management
preprint

H2O Dormant Memory: Preregistered Synthetic Evaluations and a Failed Context-Selection Non-Inferiority Test for LLM Agent Swarms

Ryoko Sakakibara
preprint en

Abstract

H2O Dormant Memory is a falsifiable prototype that keeps provenance-bearing memory units outside an active working set until typed cues reactivate a bounded subset. Six preregistered studies evaluated the approach using synthetic or repository-derived data. Early controlled tests reduced active candidates and prompt bytes while preserving quality. The final document-transformation comparison, however, failed its preregistered non-inferiority condition: submitted prompt bytes fell from 41,232 to 5,506, but quality fell from 10/12 to 6/12 because the selector omitted critical numerical evidence and a measurement-status marker. Actual billed tokens, monetary cost, provider-side memory, and energy were not measured. The result is reported as a negative finding and a design requirement for evidence-complete, reversible context selection.

Zenodo (CERN European Organization for Nuclear Research)
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.