BenchFlow 团队发布 FrontierPhysics 物理领域智能体基准

The open-source setup lets researchers rerun evaluations and inspect every test case rather than trusting a closed leaderboard, and the editing tests target a failure mode most benchmarks ignore: whether an earlier edit survives the next instruction. Teams building streaming video models can submit their API endpoint for review. The collaboration includes the National University of Singapore, giving the region a direct hand in the evaluation standard.

kimmonismus@kimmonismusSource

The non-obvious finding is that the retrieval stage, not the payload, is the weak link: attackers do not need sophisticated injection text, only repetition of the question. Teams running RAG indexes that accept external content should flag query-mirroring documents and benchmark any defensive filter on clean queries, since the tested filter cost half the ranking quality. Compared with payload-focused defences, corpus-integrity monitoring looks like the cheaper first line of defence.

rohanpaul_ai@rohanpaul_aiSource