精选理由
想了解OpenAI如何加速推理？Jalapeño芯片的表现值得关注。它比现有技术更快，值得一看。
OpenAI的Jalapeño芯片在Semianalysis的InferenceX基准测试中，每用户处理的token数量和每千瓦时的吞吐量均超过现有最先进技术。
原文 · techcrunch
OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show
Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.