Databricks 和 a16z 分析 AI 风险与网络安全挑战
Databricks' @alighodsi and a16z's Martin Casado on where the AI risk is, and what's unfolding in the...
Databricks 和 a16z 的两位大佬聊了聊 AI 风险,特别是网络安全方面,挺有意思的,可以看看他们怎么说。
Databricks 的 Ali Ghodsi 和 a16z 的 Martin Casado 讨论了 AI 风险,指出当前经济损害(如数十亿美元)与早期蠕虫病毒相比存在脱节。Ali Ghodsi 认为目前不存在存在性风险,但网络安全基础设施需要加强,因为人类无法跟上自动化检测的步伐。Martin Casado 提到,从漏洞被公开到被武器化所需的时间已从数年缩短至数小时,这带来了经济损害和人员伤害的风险。
Databricks' @alighodsi and a16z's Martin Casado on where the AI risk is, and what's unfolding in the...
Databricks' @alighodsi and a16z's Martin Casado on where the AI risk is, and what's unfolding in the cyber space: Martin: "When the internet came out, by this point... we'd disabled hospitals, we'd taken out critical infrastructure, we'd caused tens of billions of dollars in economic damages from worms. All of that had already happened." "AI has so many people that want to find risks and threats. We're running so fast, so much money has been poured into it, and we haven't seen anything commensurate with the early days of worms. What is that disconnect?" Ali: "I am sleeping well at night, and I don't think there's existential risk right now. I do think there's a lot of infrastructure that needs to be secured." "You used to have these SOC teams, security operations center people, that would look at what intrusions are happening, how are we being attacked. And now the humans just can't keep up." "The whole cybersecurity space is transitioning into being fully automated, using agents for detection." "If we don't do that, I do think you will start seeing those kind of things, like sites going down, whole systems that stop working for a while. And there will be consequences, not existential, but economic damage and people getting hurt." @martin_casado Your browser does not support the video tag. 🔗 View on Twitter a16z @a16z Databricks' @alighodsi on AI risk and adoption: Ali isn't losing sleep over the existential risk debate. He says a number of conditions would all have to be true simultaneously to enable an actual runaway takeoff scenario, and currently several opposite conditions exist. Each frontier training run requires significantly more resources. Power, GPUs, engineers - and some attempts fail, burning up huge piles of money with them. Until that reverses, he doesn't see the self-improving loop happening. Cyber is what he's watching most closely and where he anticipates real impact. Most orgs are not equipped for the coming change in agentic capabilities. The time between a vulnerability being published and being weaponized has collapsed from years to hours. On adoption, he believes most companies don't need a smarter model. The models are already smart enough. The gap is context they don't absorb - the things an employee who's worked at a company for five years learned by osmosis. If the frontier stopped advancing today, he thinks it wouldn't meaningfully change the value most are extracting from AI anyway. In conversation with a16z's Martin Casado and Sarah Wang: 00:00 Intro 00:48 Why Ali places the AI risk near zero 05:05 The word "pacing" was a mistake 10:50 What 10k agents and $100m can do 12:20 What would change his mind on AI risk 14:20 More GPUs, more ways to fail 18:05 US export controls on PlayStations 20:10 The damage everyone expected by now 24:30 Public vulnerabilities weaponized in hours 30:15 Why labs can't grade each other 37:15 Why most of RSI isn't actually RSI 40:05 Why nobody really needs a smarter model 41:50 The AI use cases nobody argues about 47:30 Google Search solved this 25 years ago 50:55 Nobody has privileged knowledge now 55:10 Same model, new harness, 2x cost 58:15 Open source: 5% of spend, 60% of tokens 1:05:30 90% of new databases are created by agents YouTube: youtu.be/GzEtpAKYRvE @databricks @martin_casado @sarahdingwang Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 3 🔄 1 ❤️ 6 👀 4998 📊 3 ⚡