Datadog CISO：AI安全方案必须理解智能体意图

他指出，编码智能体基于现有代码训练并有奖励结构，可能为了修复bug而忽略其他行为，导致奖励黑客问题。Datadog已引入一个评判系统来评估智能体的代码输出。

Escobar提到，上周的圆桌会议上，许多安全负责人感到无助，等待商业解决方案。他还讨论了将编码智能体交给4000名工程师后，原有权限体系失效的问题。

Datadog CISO Emilio Escobar says intent is now a must-have for AI security solutions: "These agents are trained on existing code, and they have a reward structure. If code is meant to solve the bug, but it gets rewarded on that, it doesn't care if it's doing something else outside of that." "You have to be careful how you prompt these things, but also how it actually interprets your prompt and executes on that. So we have this judge now evaluating the code output of the agents to then make sure that we're doing that." "I did a roundtable last week about agentic security, and the sense that I got from a bunch of the security leaders was a sense of helplessness. Of just waiting for a commercial solution to come in and solve it all." @eaescob @datadoghq

This report is categorized under AITOP's "Industry" desk. Key entities and technical topics under continuous tracking include Datadog, AI安全, 智能体, Emilio Escobar.

Source attribution: curated from a16z (@a16z).