#LLM优化
3 stories · 0 in 7 days · 1 in 30 days
Stories, products and papers tagged "LLM优化", newest first.
Nov 2
Oct 9
QUILT sparse attention mechanism
QUILT addresses a fundamental inefficiency in sparse attention kernels by eliminating redundant memory operations through cross-query reuse. This approach significantly improves performance for long-context models without compromising accuracy, making it particularly valuable for developers working with large language models like GLM-5.3 and DeepSeek-3.2 that process extensive sequences.
Aug 7
Chinese contentAmazon SageMaker Python SDK v3新增LLM推理推荐
AWS把LLM优化搬进了SageMaker的notebook,跑完基准测试直接给你部署建议,不用再手动调参了。