精选理由
NVIDIA出了个开源的模型路由库Switchyard,能让工作流里复杂步骤用强模型、简单步骤用轻量模型,省成本。
NVIDIA发布开源库NeMo Switchyard,用于智能体工作流中的模型路由。该库允许复杂推理和规划步骤调用前沿模型,高容量专门执行使用Nemotron Lightning。开发者可自定义路由策略,在成本和性能间灵活取舍。
原文 · NVIDIA AI
ICYMI: Not every step in an agent workflow needs the same model. Meet NVIDIA NeMo Switchyard, a n...
ICYMI: Not every step in an agent workflow needs the same model. Meet NVIDIA NeMo Switchyard, a new open-source library for model routing. Use frontier models for complex reasoning and planning, and NVIDIA Nemotron Lightning for high-volume, specialized execution. Your browser does not support the video tag. 🔗 View on Twitter 💬 1 🔄 4 ❤️ 7 👀 1649 📊 3 ⚡