Martian 推出了 AI Frontier 工具，能帮你对比 44 个 LLM 的性能，比单一模型少 46% 错误，还能优化模型组合。
Martian's AI Frontier 工具支持对比 44 个大语言模型，通过成本、质量和可靠性指标评估。该工具在 16 个常用基准测试（如 TerminalBench、LiveCodeBench）中实现了比最佳单一模型少 46% 的错误率。用户可以通过路由和重复采样技术优化模型组合，提升在编程、推理、事实性和智能体任务中的表现。
Impressive tool to explore frontier AI capabilities. Martian's AI Frontier lets you compare 44 LLMs...
Impressive tool to explore frontier AI capabilities. Martian's AI Frontier lets you compare 44 LLMs by measured cost, quality, and reliability, then see how routing and repeated sampling change the frontier. I like this because builders can choose model combinations using real tradeoffs across coding, reasoning, factuality, and agentic tasks. Martian @withmartian We got 46% fewer errors than the single best LLM across the 16 most used benchmarks (TerminalBench, LiveCodeBench, etc). Here's how that's possible and what each model can achieve when used optimally (every benchmarks misses the majority of model capabilities) 👇 Interactive Site: aifrontier.withmartian.com h Academic Paper: arxiv.org/abs/2606.26836 5 Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 3 🔄 1 ❤️ 19 👀 3846 📊 5 ⚡