Fireworks AI 搞了个 Nexus，能自动把简单活儿丢给开源模型省钱，难的留给前沿模型，还能缓存提示省 token，集中管预算权限，团队省心省力。
Fireworks AI 发布 Fireworks Nexus，解决团队构建 AI 基础设施的难题。该工具提供智能路由，自动将常规任务分配给成本效益高的开源模型，保留前沿模型处理最难的推理任务。它还包含高性能提示缓存，大幅减少冗余 token 支出。同时支持集中预算、策略和可见性，覆盖每个开发者和每个 AI 工具。
The challenge is that building the right infrastructure isn’t trivial. Most teams don’t have the ti...
The challenge is that building the right infrastructure isn’t trivial. Most teams don’t have the time to build: - Intelligent routing that automatically sends routine work to cost-effective open models and reserves frontier models for the hardest reasoning tasks. - High-performance prompt caching that dramatically reduces redundant token spend. - Centralized budgets, policies, and visibility across every developer and every AI tool. That’s why we built Fireworks Nexus. 💬 1 🔄 0 ❤️ 1 👀 320 📊 1 ⚡