MiniMax 工程师解析量化与投机解码对生产推理的影响
MiniMax 的工程师要拆解量化、投机解码这些加速手段在生产里的隐藏代价,做推理部署的可以去听听 10 月 14 日这场。
MiniMax 的 Morgan Suo 将在 10 月 14 日 AI Engineer New York 大会上讲解模型加速的底层机制。演讲主题覆盖量化、投机解码和推理控制三项技术在生产环境中的实际开销。内容聚焦于模型变快的背后,推理质量与成本会随之发生哪些变化。活动详情通过 ai.engineer/nyc 提供。
Your model got faster. What changed underneath? Morgan Suo of @MiniMax_AI on what quantization, speculative decoding and reasoning controls change in production. The Hidden Costs of a Faster Model Oct 14, AI Engineer New York Tickets: ai.engineer/nyc 💬 0 🔄 0 ❤️ 2 👀 663 ⚡