想让AI模型按你的数据跑分?Optima能自定义基准,比通用榜单靠谱。
Artificial Analysis发布Optima平台,允许用户用自有数据和工作流构建自定义AI基准。该平台可按质量、单项任务成本和耗时对比模型。对于智能体应用,这些指标比原始token定价更能反映实际表现。
Optima tackles AI benchmarking's biggest flaw by letting users test models against their own data
Artificial Analysis has launched Optima, a platform that lets users build custom AI benchmarks from their own data and workflows. Models can be compared not just on quality but also on cost and time per task. For agent-based applications, those metrics often tell you more than raw token pricing. The article Optima tackles AI benchmarking's biggest flaw by letting users test models against their own data appeared first on The Decoder .