Attention-Derived Dependency Cut for Independent KV-Cache Reuse in Agent Memory

Long-term agent memory grows continuously with interaction, making full-memory prefill increasingly costly in terms of time to first token (TTFT) and redundant computation. KV-cache reuse could avoid repeatedly prefilling the accumulated memory, but KV caching relies on exact prefix matching. When memory is updated, reorganized, or assembled from reusable units, prefix mismatches prevent direct reuse of existing KV caches and force the model to recompute a long memory prefix. Existing methods largely assume that memory blocks are already given and address the prefix-matching limitation by concatenating their KV caches and then repairing the resulting mismatch. We therefore argue that the primary question for agent-memory KV reuse is where to segment the memory. We propose AD-CUT, an Attention-derived dependency Cut method for training-free, independence-oriented segmentation. AD-Cut computes attention-derived dependency signals over sentence-level atomic units, including an incoming signal Ain and an outgoing signal Aout, and selects boundaries where both signals are low. The signals exhibit stable positive associations with intervention-derived KV and NLL sensitivity, with Spearman ρ ranging from 0.615 to 0.868 and context-cluster bootstrap intervals remaining positive, supporting their use as predictive proxies. In block-KV serving for agent QA, AD-Cut achieves a 16.17× Online TTFT speedup with a QA Quality Retention of 0.7675. It also improves task quality over naive sentence-level reuse in a controlled agent-memory evaluation. These results show that AD-Cut substantially reduces online computation while mitigating the quality loss caused by KV-cache reuse.

Authors

Institutions

Publication Details

Journal
International Journal of Network Dynamics and Intelligence
Published
2026-11-06
DOI
https://doi.org/10.53941/ijndi.2026.100023
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Attention-Derived Dependency Cut for Independent KV-Cache Reuse in Agent Memory

Yizhuo Zhao, Boxi Wu, Xiaofei He
International Journal of Network Dynamics and Intelligence
Natural Language Processing Techniques
article

Attention-Derived Dependency Cut for Independent KV-Cache Reuse in Agent Memory

Yizhuo Zhao, Boxi Wu, Xiaofei He
article en

Abstract

Long-term agent memory grows continuously with interaction, making full-memory prefill increasingly costly in terms of time to first token (TTFT) and redundant computation. KV-cache reuse could avoid repeatedly prefilling the accumulated memory, but KV caching relies on exact prefix matching. When memory is updated, reorganized, or assembled from reusable units, prefix mismatches prevent direct reuse of existing KV caches and force the model to recompute a long memory prefix. Existing methods largely assume that memory blocks are already given and address the prefix-matching limitation by concatenating their KV caches and then repairing the resulting mismatch. We therefore argue that the primary question for agent-memory KV reuse is where to segment the memory. We propose AD-CUT, an Attention-derived dependency Cut method for training-free, independence-oriented segmentation. AD-Cut computes attention-derived dependency signals over sentence-level atomic units, including an incoming signal Ain and an outgoing signal Aout, and selects boundaries where both signals are low. The signals exhibit stable positive associations with intervention-derived KV and NLL sensitivity, with Spearman ρ ranging from 0.615 to 0.868 and context-cluster bootstrap intervals remaining positive, supporting their use as predictive proxies. In block-KV serving for agent QA, AD-Cut achieves a 16.17× Online TTFT speedup with a QA Quality Retention of 0.7675. It also improves task quality over naive sentence-level reuse in a controlled agent-memory evaluation. These results show that AD-Cut substantially reduces online computation while mitigating the quality loss caused by KV-cache reuse.

International Journal of Network Dynamics and IntelligenceVol. 5(3)
Imperial College London (GB)
Openalex Percentile: Top 19%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Attention-Derived Dependency Cut for Independent KV-Cache Reuse in Agent Memory — Yizhuo Zhao, Boxi Wu, et al. · International Journal of Network Dynamics and Intelligence (2026) | TGRS Research Map | TGRS