OpenAI 搞了个新模型 GPT-5.6 Sol,能自己优化自己,部署后服务成本直接降了20%,生成速度还快了15%,搞推理服务的值得关注。
OpenAI 发布了 GPT-5.6 Sol,专门用于提升生产环境的服务效率。部署后,该模型通过自我优化机制进一步降低运行成本。具体改进包括:GPU 内核优化使服务成本降低 20%;推测解码算法改进使 token 生成效率提升超过 15%。
GPT-5.6 Sol for improving production serving efficiency. One of the ways we're able to get such grea...
GPT-5.6 Sol for improving production serving efficiency. One of the ways we're able to get such great price-performance: OpenAI @OpenAI After deployment, we applied GPT-5.6 Sol to advance the frontier of efficiency by making itself more efficient to run. The results: - 20% lower serving costs from production GPU kernel improvements. - 15%+ better token-generation efficiency from improved speculative decoding. 🔗 View Quoted Tweet 💬 30 🔄 11 ❤️ 283 👀 22017 📊 36 ⚡