产品78°
Cohere发布首个基于解码内核的LLM服务系统
Introducing the next evolution in LLM text generation: the first fully-fledged serving system built ...
精选理由
Cohere开源了比vLLM快1.58倍的LLM服务系统，专为North Mini Code设计。
Cohere推出首个完全基于解码内核的LLM文本生成服务系统。该系统性能比vLLM快达1.58倍。系统专为North Mini Code构建，完全开源。该系统代表了LLM文本生成的最新演进。
原文 · Cohere
Introducing the next evolution in LLM text generation: the first fully-fledged serving system built ...
Introducing the next evolution in LLM text generation: the first fully-fledged serving system built around a decode megakernel. Delivering up to 1.58x faster performance than vLLM. Built for North Mini Code, completely open-source. 💬 1 🔄 0 ❤️ 2 👀 300 📊 1 ⚡
