OpenAI 发布 LifeVal 基准，评测模型处理日常任务的能力
OpenAI 拿几千个 ChatGPT 用户的需求做了个 LifeVal 基准，专门测模型能不能帮你找托儿、办政务、管账单，思路挺不一样的。
OpenAI 推出 LifeVal 基准，基于数千名 ChatGPT 用户对个人助理需求点的反馈设计，覆盖育儿资源查找、政务服务办理、个人财务管理等日常场景。过去一年 OpenAI 用 LifeVal 测量并改进旗下模型在这些任务上的表现。该基准把评测方向从学术基准转向真实用户最想获得帮助的生活事务。
For AGI to benefit all of humanity, it should help people with the everyday tasks that matter most to them. So we built LifeVal, a new benchmark shaped by feedback from thousands of ChatGPT users on where they most want help from a personal assistant—from finding childcare to accessing government services to managing personal finances. Over the past year, we’ve used LifeVal to measure and improve how well our models handle these everyday tasks. openai.com/index/lifeval/ Your browser does not support the video tag. 🔗 View on Twitter 💬 352 🔄 180 ❤️ 3006 👀 220820 📊 615 ⚡
