#WUSH-KV

1 stories · 0 in 7 days · 0 in 30 days

KV cache 1 RoPE 1 SGLang 1 quantization 1

Stories, products and papers tagged "WUSH-KV", newest first.

Sep 30

Papers Builders10:26

Chinese contentWUSH-KV: KV缓存量化新方法

WUSH-KV用数据自适应变换降低KV缓存量化误差，2-bit性能超越OSCAR，适合长上下文推理场景。

#WUSH-KV #KV cache #quantization #SGLang

arXiv cs.LG@Jiale Chen et al. (5)Source