#LLM优化

3 stories · 0 in 7 days · 1 in 30 days
Stories, products and papers tagged "LLM优化", newest first.
Nov 2
Oct 9
PapersBuildersSelected10:21
QUILT sparse attention mechanism

QUILT addresses a fundamental inefficiency in sparse attention kernels by eliminating redundant memory operations through cross-query reuse. This approach significantly improves performance for long-context models without compromising accuracy, making it particularly valuable for developers working with large language models like GLM-5.3 and DeepSeek-3.2 that process extensive sequences.

arXiv: DeepSeek@Zhenduo Zhao et al. (10)Source
Aug 7
LLM优化 · AI news | AITOP