Latest

Every published item, in order · 763 items
Oct 1
Sep 30
Sep 29
Sep 28
ModelsBuildersMulti-sourceSelected73°20:34
Artificial Analysis Cyber Index Ranks AI Models on Cyber Defense

Safety refusals, not coding skill, now decide leaderboard rankings on defensive security work, a factor most agent benchmarks ignore. Security teams choosing models for vulnerability triage should check refusal rates alongside raw scores, since a top coder may decline a third of real tasks. The ranking also spans Chinese and US labs, making it a useful cross-vendor comparison point.

Event
官方账号Artificial Analysis@ArtificialAnlys11 sourcesSource
IndustryBuildersSelected73°08:45
Simon Willison's 2026 LLM Year Review Keynote

The talk frames late 2025 model releases as the moment coding agents crossed from error-prone to dependable, a shift with practical consequences for how teams staff and structure engineering work. Practitioners evaluating agent workflows can use the annotated slides as a curated timeline of which models and tools mattered. Willison's pelican-bicycle test also offers a lightweight way to compare model capabilities hands-on.

Event
官方账号Simon Willison’s Weblog2 sourcesSource