RidgeFill Retrofit Speeds Prefill on Qwen and Llama Models
The non-obvious point is that YOCO-style self-forecasting caches, previously requiring dedicated training like DeepSeek-V4.1-Flash, can now be retrofitted onto off-the-shelf checkpoints with no training and no dropped tokens. Engineers deploying long-context inference in llama.cpp or vLLM can use it to cut time to first token on a single A100. Benchmarks like RULER and LongBench v2 let readers judge the quality cost themselves.