NVIDIA发布Nemotron 3.5 Lightning,3B参数主打低延迟

https://t.co/KDHS7kioqT

精选理由

NVIDIA出了个轻量级新模型,3B参数跑得快又便宜,延迟敏感场景用得上,Tinker上现在就能玩。

AI 摘要

NVIDIA今日推出Nemotron 3.5 Lightning模型,并已上线Tinker平台。该模型仅激活3B参数,针对吞吐速度进行优化。它面向对延迟和成本敏感的应用场景,适合高频实时推理任务。用户可在Tinker上直接体验该模型。

原文 · NVIDIA AI

https://t.co/KDHS7kioqT

x.com/tinkerapi/stat… Tinker @tinkerapi Nemotron 3.5 Lightning from @NVIDIAAI is out today and available on Tinker. With just 3B active parameters and optimized for throughput speed, 3.5 Lightning is designed for work where latency and cost matter. 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 1 👀 254 ⚡

NVIDIA发布Nemotron 3.5 Lightning,3B参数主打低延迟 · AI 热点