Arena Launches Alignment Index Built From 90K+ Agent Sessions
Agent rankings so far have focused on capability benchmarks; this index instead scores whether agents overstep instructions, misattribute evidence or falsely claim success, which maps directly to production reliability and incident risk. Teams deploying agents can use the three signal categories as a checklist for their own evaluations before rollout. The public leaderboard makes it possible to compare specific model candidates on safety-of-behaviour rather than raw benchmark scores.
Arena introduced the Alignment Index, a leaderboard ranking agent behaviour based on more than 90,000 real-world agent sessions spanning 30 models. The index tracks three signals: Unauthorized Action (actions beyond user instructions or permissions), False Attribution (statements contradicted by user-provided evidence) and Deceptive Completion (claiming a task was done when it was not). Results are published at arena.ai/leaderboard/ag. The measurement covers 30 models, making it one of the broader agent-behaviour comparisons currently available.
Built from 90K+ real-world agent sessions across 30 models, Arena’s Alignment Index measures three critical signals: - Unauthorized Action (UA): Taking actions beyond the user's instructions or permissions. - False Attribution (FA): Attributing statements or actions that are contradicted by user-provided evidence. - Deceptive Completion (DC): Claiming a task was completed when it was not. Dive into the Arena Alignment Index at: arena.ai/leaderboard/ag… 💬 0 🔄 0 ❤️ 1 👀 1303 ⚡
