ModelsSelected

NVIDIA Nemotron 3.5 Super VL Scores 1.94% on ARC-AGI-2

Why we picked it

The pricing is the notable part: at two to three cents per task, Nemotron 3.5 Super VL is positioned as a low-cost vision-language option even though its abstract-reasoning scores trail the leaders. Teams benchmarking multimodal models against ARC-AGI can compare cost-performance trade-offs directly, since ARC Prize reports price alongside accuracy for every entry.

NVIDIA's Nemotron 3.5 Super VL has been evaluated on the ARC-AGI benchmark for the first time, marking the first NVIDIA model tested by the ARC Prize team. The model scored 1.94% on ARC-AGI-2 at a cost of US$0.02 per task. On the earlier ARC-AGI-1 benchmark, it reached 22.67% at US$0.03 per task. The results were published by the ARC Prize team on X.

Original · ARC Prize

NVIDIA Nemotron 3.5 Super VL from @NVIDIAAI on ARC-AGI (Verified):

- ARC-AGI-2: 1.94%, $0.02/task - ARC-AGI-1: 22.67%, $0.03/task

Nemotron 3.5 Super VL is the first NVIDIA model we've evaluated on ARC-AGI. https://t.co/UhP4mRioqN