AITOPAI热报
ProductsMulti-sourceSelected

Artificial Analysis adds GPU rental pricing to AA-AgentPerf benchmark

官方账号Artificial Analysis@ArtificialAnlys
Post· 11 sources
View the post
Why we picked it

Benchmark rankings now reflect what compute actually costs to rent, shifting comparisons from raw throughput to value per dollar. Teams sizing agent deployments can use the daily-updated indices to pick hardware that maximises agent throughput within a fixed compute budget. The included AMD MI355X figure is an assumption from market quotes rather than an official index, so treat that data point with caution.

Artificial Analysis is collaborating with Silicon Data to integrate market-based GPU rental pricing into AA-AgentPerf, its datacenter system performance benchmark. The new metric, Throughput per $/hr, divides total system throughput by hourly rental cost. Silicon Data rental price indices are tracked daily across cloud providers for H100, H200, B200 and B300 GPUs. Among systems with available pricing, NVIDIA's B300 generally leads, while B200 matches it at faster output speeds on some models. A MI355X rental rate in the published chart is assumed by Artificial Analysis based on recent market quotes.

Original · Artificial Analysis

We are collaborating with Silicon Data to bring market-based GPU pricing into AA-AgentPerf, our datacenter system performance benchmark

Our users and partners want to know how much agent work they can support per dollar of compute. @silicondata's rental price indices allow us to report a reliable value-for-money metric, updated daily as prices change. We currently display Silicon Data indices for H100, H200, B200 and B300, tracked across cloud providers

The new metric is Throughput per $/hr, which divides the total throughput of a system and serving configuration by the hourly cost of renting that system. Among systems with available rental pricing, NVIDIA’s B300 generally leads, while B200 matches it at faster output speeds on some models

Note: the below chart includes an MI355X rental rate that has been assumed by Artificial Analysis based on recent market quotes

#Artificial Analysis#Silicon Data#AA-AgentPerf#GPU pricing#benchmarks

Keep reading

Recent stories with the same tag or section
ModelsBuildersSelected09:47
AA-PersonalityBench: open weights models lag proprietary on truthfulness

The gap pattern suggests open weights models optimise toward punchy, scannable output at the cost of factual care and structure, a trade-off worth weighing when picking models for enterprise or research workflows. Teams choosing between open weights deployments and proprietary APIs can use the 30-trait percentiles as a filter beyond raw intelligence scores. The benchmark also gives prompt engineers concrete levers for compensating where open models fall short.

#AA-PersonalityBench#Artificial Analysis#open-source models#benchmarks
官方账号Artificial Analysis@ArtificialAnlysSource
ModelsUS vs ChinaSelected00:45
Kimi K3.1 Pro shows largest personality shift in AA-PersonalityBench

A personality rewrite this large between consecutive versions means teams tuning prompts or evals around Kimi K3's behavioural profile may see different outputs after upgrading. Developers building character-driven agents or customer-facing assistants should re-run behavioural evaluations before switching to K3.1 Pro. The benchmark also offers a reusable method for tracking such shifts across any model lineage.

#Kimi#Moonshot#AA-PersonalityBench#benchmark
官方账号Artificial Analysis@ArtificialAnlysSource