Y Combinator Paper Club 请了三位专家，分别讲了智能体基准测试、扩散语言模型和实用缩放定律，都是数据相关的前沿话题。
Y Combinator Paper Club 本周聚焦数据。随着模型在任务和语言上扩展，关于训练和评估的旧假设开始失效。专家们讨论了训练数据、基准测试和多语言预训练的挑战与前沿。Vincent Sunn 谈论了智能体基准测试的艺术与科学。Volokhuleshov 介绍了 Inception 扩散语言模型。Shayne Redford 讲解了 ATLAS 多语言模型的实用缩放定律。
This week's Paper Club is focused on data. As models have scaled across tasks and languages, old ass...
This week's Paper Club is focused on data. As models have scaled across tasks and languages, old assumptions about training and evaluation are starting to break. So we gathered three domain experts to break down the challenges and frontiers of training data, benchmarks, and multilingual pre-training. Thanks to the following presenters: 00:00 - @FrancoisChauba1 : Why a whole night about data? 9:51 - @vincentsunnchen : The Art & Science of Benchmarking Agents 28:44 - @volokuleshov : Inception: Diffusion Language Models for Production 40:26 - @ShayneRedford : ATLAS: Practical Scaling Laws for Multilingual Models Your browser does not support the video tag. 🔗 View on Twitter 💬 6 🔄 5 ❤️ 19 👀 10977 📊 9 ⚡