做 AI 推理的团队终于有了按需降本的方法——不用改代码就能自动切换更便宜的模型，适合处理大量相似任务的开发者直接试试。
大多数 AI 团队仍像从单一供应商买软件一样购买推理服务：选一个模型、接受固定价格、持续付费，即使更便宜的模型也能完成相同工作。The Grid AI 采用不同方法：用户只需选择任务等级（标准、高级、最大），系统自动将请求路由到符合该等级的最便宜供应商。这意味着应用使用同一 API，但背后的模型可随价格和质量变化。作者在 Ubuntu 上测试了 Hermes Agent 与 The Grid 的集成，用于读取支持工单、应用策略文件并编写分类报告。
Most AI teams still buy inference like they are bu…
Most AI teams still buy inference like they are buying software from 1 vendor.
They pick a model, accept the fixed price, wire it into the app, and keep paying that rate even when cheaper models could handle the same work.
@The_GridAI takes a different approach.
Instead of choosing a model name, you choose the level of work you need: standard, prime, or max. A simple task like support-ticket classification can run on standard. Normal production work like RAG, drafting, support replies, or agent steps can run on prime. Harder work with long context or higher error cost can run on max.
The Grid then routes the request to the cheapest supplier that still qualifies for that tier.
So the app still uses one API and mostly the same code, but the model behind the request can change as price and quality change.
I tested it with Hermes Agent on my Ubuntu machine. Hermes ran locally, while The Grid handled the inference through agent-prime. The workflow was simple: read support tickets, apply a policy file, and write a triage report.