Deepnote 发布企业 Slack 智能体测试基准
Deepnote 搞了个模拟公司 Slack 的智能体基准：11 个服务、50 种场景、3 分钟内决策。最狠的是它测“什么时候该闭嘴”，这是很多 Slack 机器人最缺的能力。做内部智能体的开发者可以直接套用这个测试思路。
数据分析平台 Deepnote 发布了一个面向智能体的测试基准，模拟一家公司的 Slack 环境。智能体可以访问 11 个服务的记录，面对 50 种不同情境，只有 3 分钟时间进行调查并做出决定。
这个基准重点考察三件事：智能体知道什么时候该帮忙、帮忙时是否准确、以及知道什么时候应该保持沉默。第三点尤其关键——现实中企业 Slack 里的机器人经常在没人召唤时插话，或者在不该发言的场景强行回应，反而制造噪音。
对开发者来说，这个基准比单纯的问答测试更贴近真实工作场景，因为决策限时、多源信息检索和克制发言都是部署企业智能体时最难调好的部分。做 Slack 机器人或内部工具智能体的团队可以直接拿来当回归测试用。
This is a really good test for agents:
It's a benchmark released by Deepnote. (I've used their platform for 5+ years and I love it!)
The benchmark tests agents in a simulated company's Slack:
• Agents get access to records across 11 services • They face 50 different situations • They have 3 minutes to investigate and decide
Here is what they test:
1. Does the agent know when to help? 2. Does the agent know how to help accurately? 3. Does the agent know when to stay quiet?
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Deepnote, agents, Slack, benchmarks.
Source attribution: curated from Ate-a-Pi (@svpino).
