想测你的研究智能体能不能又广又深地搜证据?Perplexity 新出 WANDR 基准,500个任务等着,看看 Search as Code 怎么跑到了0.36 F1。
Perplexity AI 发布了开放基准 WANDR,包含500个证据密集型任务,用于评估研究智能体在搜索广度和深度上的表现。该基准测试智能体能否发现多个符合条件的实体,并为每个实体提供可验证的引用证据。当前 Perplexity Search as Code 以 soft F1 0.363 和 hard F1 0.133 的成绩领先。
Perplexity AI Releases WANDR: An Open Benchmark Evaluating Research Agents That Must Search Wide And Deep
Perplexity's WANDR is an open benchmark and evaluation harness with 500 evidence-heavy tasks. It tests whether research agents can discover many qualifying entities and back each one with cited, re-verifiable evidence. Perplexity Search as Code leads at 0.363 soft F1 and 0.133 hard F1. The post Perplexity AI Releases WANDR: An Open Benchmark Evaluating Research Agents That Must Search Wide And Deep appeared first on MarkTechPost .