产品精选

Fireworks 发布 ARCv3 压缩器,将 BF16 权重更新体积削减近 50%

ARCv3 is Fireworks' new compressor for RL. It cuts the size of BF16 weight updates by nearly 50%, ...

精选理由

Fireworks 出了个 ARCv3 压缩器,能把 BF16 权重更新压小近一半,自己搭 trainer 跑 RL 的团队可以省不少跨区传输成本。

Fireworks 推出面向强化学习训练的压缩器 ARCv3。它将 BF16 格式的权重更新体积压缩近 50%,使跨区域分布式训练更可行。这能保证 rollout 数据保持同步更新,适用于自建 trainer 配合 Fireworks rollout 的团队。

图片来源 · Fireworks AI
原文 · Fireworks AI

ARCv3 is Fireworks' new compressor for RL. It cuts the size of BF16 weight updates by nearly 50%, ...

ARCv3 is Fireworks' new compressor for RL. It cuts the size of BF16 weight updates by nearly 50%, which makes cross-region training more practical and keeps rollouts current. For teams using their own trainer with Fireworks rollouts: fireworks.ai/blog/arcv3-and… 💬 0 🔄 1 ❤️ 2 👀 311 📊 1 ⚡