ProductsSelected

Salesforce 打造自进化数据科学智能体,预测漂移排查时间从数小时缩至 27 分钟

Why we picked it

Salesforce 把自家的预测运维做成了会自我进化的智能体,排查漂移只要 27 分钟,sMAPE 还降了 14%。关键是它每次修复都从审核反馈里学习,比一次性工具更能沉淀经验。做大促预测、时间序列监控的团队可以看看这套人机分工设计。

Salesforce 研究团队发布一个自进化数据科学智能体,用于维护支撑全球云基础设施的约 400 万条夜间预测。过去指标漂移后的排查靠人工调试,往往耗时数小时;该智能体可自动调查预测漂移、在 Slack 中搜索上下文、并行运行回测,并从每次调查和人工审核反馈中更新自己的操作手册,最后提交 PR 交由人类批准。

Image · Salesforce AI Research
Body

实测数据方面,智能体将调查时间的中位数压缩到 27 分钟,在 100 多项候选模型改进的回测中,sMAPE 误差平均降低 14%。其核心机制是把调查流程沉淀为可迭代的 playbook:每完成一次修复,智能体都会吸收审核者的判断,让下一次排查更精准。对运行大规模时间序列预测的数据团队而言,这种“智能体执行、人类把关”的分工提供了可复用的运维范式。

Original · Salesforce AI Research

Every night, Salesforce runs millions of forecasts to power our global cloud infrastructure. When metrics shift, keeping them accurate used to take hours of manual debugging.

So we built a self-evolving data science agent that investigates forecast drift, searches Slack for context, runs parallel backtests, updates its playbook from reviewer feedback, and opens a pull request for a human to approve.

https://t.co/r8YSZgq28R

→ 27-min median investigations, down from hours → 14% lower sMAPE error in backtests across 100+ proposed model improvements → Learns from every investigation and reviewer feedback → Built for a platform running ~4M forecasts every night

The agent gets a little smarter with every fix, and our data scientists get their days back to build what comes next. It’s a partnership that keeps improving: the agent handles the investigating, and our team guides it with their judgment.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Salesforce, agents, time series forecasting, MLOps.

Source attribution: curated from Salesforce AI Research (@SFResearch).