Latest

Every published item, in order · 7652 items
Oct 15
PapersBuildersSelected12:52
BizBench Benchmark Tests Agent Execution Validity in Payments Workflows

The benchmark shows that outcome-only evaluation masks invalid execution, since models can hit the final goal while violating constraints mid-run — a gap that matters most in regulated domains like payments where intermediate errors carry financial or compliance consequences. Agent builders can use the 50-task suite and deterministic checks to measure constraint compliance and tool-call overhead, not just task success. Teams choosing models for workflow automation get a direct comparison of frontier and open models under identical conditions.

arXiv: DeepSeek@Enhan Zhao et al. (9)Source
Tomorrow 08:00, the daily lands in your inboxTelegram channel or email. Same screening as this page, no ads.

Only the latest 2000 items are listed; for older ones see the daily archive