#StreamEval

1 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "StreamEval", newest first.
Nov 6
PapersBuildersSelected03:13
StreamEval benchmark tests 38 models on real-time video AI

The open-source setup lets researchers rerun evaluations and inspect every test case rather than trusting a closed leaderboard, and the editing tests target a failure mode most benchmarks ignore: whether an earlier edit survives the next instruction. Teams building streaming video models can submit their API endpoint for review. The collaboration includes the National University of Singapore, giving the region a direct hand in the evaluation standard.

kimmonismus@kimmonismusSource