AI模型精选

@perplexity_ai 正确基准测试文档理解

Big shoutout to @perplexity_ai for properly benchmarking document understanding in their Portable Co...

精选理由

@perplexity_ai 发布了Portable Computer,这是一个本地优先的智能体,在文档理解方面表现优异,比开源的Pi和Hermes更胜一筹,值得一试。

AI 摘要

@perplexity_ai 在Portable Computer版本中正确基准测试文档理解,使用ParseBench子集,涵盖表格、图表、布局、文本内容和格式。Portable Computer是一个本地优先的智能体,用于私有和成本效益的工作,27B模型在真实知识工作上得分82.6%,超过开源的Pi和Hermes。经过微调的PPLX 27B达到85.4%

原文 · Jerry Liu

Big shoutout to @perplexity_ai for properly benchmarking document understanding in their Portable Co...

Big shoutout to @perplexity_ai for properly benchmarking document understanding in their Portable Computer release 🔥 They took a subset of our ParseBench benchmark parsebench.ai X) and measured across tables, charts, layout, text content, and formatting. Document understanding is the first step towards most knowledge work, and its capabilities are a function of both the model and harness. As companies build new models and agents that push the frontiers of knowledge work, we hope to see document understanding be a core part of any benchmarking effort. Perplexity @perplexity_ai New research: Portable Computer is a local-first agent for private and cost-effective work. With an on-device 27B model, our harness scores 82.6% on real knowledge work, beating open-source harnesses Pi and Hermes. Our post-trained PPLX 27B reaches 85.4%. 🔗 View Quoted Tweet 💬 2 🔄 2 ❤️ 3 👀 1147 📊 3 ⚡

  • Perplexity08-25 18:43原文
  • Aravind Srinivas08-25 20:08原文