论文精选

Bounded-State Restoration: 解耦本地恢复与外部状态

Bounded-State Restoration: Decoupling Local Restore Capacity from External LLM State

精选理由

DeepSeek团队提出BSR方法,让LLM在极小内存下恢复超大状态,比传统方法高效63倍。

AI 摘要

论文提出Bounded-State Restoration(BSR)方法,分离完整发现与本地驻留。在DeepSeek-V4-Flash模型测试中,外部状态达31.277 GiB/rank时,L1 RWS仅保持500.75 MiB/rank,实现63.959倍的外部到实时暂存比例。BSR通过最多W个块的窗口安装确认状态,在辅助状态有界的情况下,恢复容量为O(W)。SSD优化将512K恢复TTFT从43.1降至17.6秒,不改变RWS大小。

原文 · arXiv: DeepSeek

Bounded-State Restoration: Decoupling Local Restore Capacity from External LLM State

Hierarchical KV-cache systems can retain long-context LLM execution state beyond GPU memory, but retention capacity does not determine the local memory required to make that state executable again. We isolate this second resource as the restoration working set (RWS): the peak local staging state whose lifetimes overlap during restoration. In the pinned upstream LMCache whole-plan path, measured full-reuse points for 1.956, 7.823, and 15.646 GiB/rank states first succeed at 2, 8, and 16 GiB L1 rungs, with successful L1 peaks of 1.956, 7.824, and 15.648 GiB/rank. We introduce Bounded-State Restoration (BSR), which separates complete discovery from local residency. BSR probes the complete reusable prefix without materializing the whole hit in L1, then installs confirmed state through a reusable window of at most $W$ chunks. Under bounded auxiliary state, peak restoration capacity is $O(W)$ while total transfer and installation work remains $Θ(|S|)$. Because reusable state spans heterogeneous allocator groups and tensor-parallel ranks, BSR uses a request-level commit rule: partial installation is never exposed as a valid reusable prefix; failures invalidate the advertised prefix and fall back to a lower valid tier or deterministic recomputation. On DeepSeek-V4-Flash with TP=2 across two DGX Spark nodes, a clean no-resume sweep grows external state from 1.956 to 31.277 GiB/rank while measured L1 RWS remains exactly 500.75 MiB/rank at $W=32$, a 63.959x largest-state external-to-live-staging ratio. A second fresh 524K-token run repeats the largest-state acceptance result. Evaluated tier and rank-asymmetric failures expose either complete reuse or zero external reuse before fallback. A matched SSD optimization reduces 512K restore TTFT from 43.1 to 17.6 seconds without changing RWS.

Bounded-State Restoration: 解耦本地恢复与外部状态 · AI 热点