AI产品精选

NVIDIA Dynamo冷启动优化

When an LLM engine crashes, a cold restart can mean minutes of lost capacity. Shadow engine recover...

精选理由

NVIDIA Dynamo新功能Shadow engine恢复,比冷启动快39倍,效率提升显著!

AI 摘要

NVIDIA Dynamo新增Shadow engine恢复功能,GLM-5.2测试中恢复容量仅需7.3秒,比冷启动快近39倍。

原文 · NVIDIA AI

When an LLM engine crashes, a cold restart can mean minutes of lost capacity. Shadow engine recover...

When an LLM engine crashes, a cold restart can mean minutes of lost capacity. Shadow engine recovery, a new preview feature in NVIDIA Dynamo, keeps a standby engine warmed up and ready to take over. In our GLM-5.2 test, it restored capacity in 7.3 seconds, nearly 39x faster than a cold restart. Read all about it: nvda.ws/45OhcA0 💬 1 🔄 2 ❤️ 27 👀 2098 📊 5 ⚡

NVIDIA Dynamo冷启动优化 · AI 热点