Jev flags alignment failures with one yes/no question
The cost gap, 62x cheaper than LLM judges, makes calibrated decision models a practical replacement for expensive evaluation pipelines. It also surfaces label errors in three existing benchmarks, which anyone relying on published alignment scores should note. Thresholds do not transfer between benchmarks, so teams adopting this should fit one on roughly 10 labelled items, which lifts median F1 from 0.706 to 0.793.
