Latest

The method cuts indexer cost, which accounts for over half of prefill time at one million tokens, without the recall degradation that two-stage block approaches like HiSA suffer as context grows. Serving teams running long-context inference on models with learned sparse attention, such as GLM-5 or DeepSeek-V4, can use it to raise prefill throughput 1.3-1.8 times while preserving retrieval accuracy. Both target models come from Chinese labs, making it directly relevant to practitioners deploying these open-weight models.

A 35B model matching frontier-scale systems on MLE-Bench Lite suggests agentic MLE performance depends more on training method than raw parameter count, lowering the hardware bar for teams building autonomous experimentation agents. The WIRL reward design over multi-turn execution windows is a reusable recipe for anyone training long-horizon agents beyond ML engineering. The paper also ships an executable task factory, so practitioners can adapt the harness to their own domains.

This approach solves a critical bottleneck in long-context AI serving by enabling more efficient memory usage while maintaining high throughput. The technology allows models to handle significantly larger contexts without hitting memory limits, which directly impacts real-world applications requiring extensive context windows. Developers working with large language models should consider this optimization technique to improve performance in production environments.

QUILT addresses a fundamental inefficiency in sparse attention kernels by eliminating redundant memory operations through cross-query reuse. This approach significantly improves performance for long-context models without compromising accuracy, making it particularly valuable for developers working with large language models like GLM-5.3 and DeepSeek-3.2 that process extensive sequences.

SPLASH eliminates the need to restart workers when changing attention layouts, enabling dynamic adaptation to varying workloads. Developers can implement this to optimize LLM serving efficiency across different hardware configurations and model sizes, with particular benefits for handling mixed workloads that transition between short and long requests.

This research explores a conditional path toward quantum scaling for long-horizon reasoning, a key challenge in advanced AI systems.

The protocol helps developers verify anonymous AI models, addressing supply-chain risks and capability expectations in the rapidly evolving AI market.