行业73°

OpenAI投入20%计算资源应对对齐问题,Marcus呼吁投资替代方案

Counterpoint: “If alignment issues are becoming big enough that OpenAI is willing to commit 20% of r...

精选理由

Gary Marcus指出OpenAI用20%算力监控对齐问题,证明LLM架构有缺陷,呼吁投资替代方案。

AI 摘要

OpenAI将20%的研究推理计算资源用于思维链监控,显示对齐问题日益严重。Gary Marcus认为这表明LLM架构在对齐方面正在失败。他呼吁业界投资更多替代LLM的方案,并制定跨实验室的通用政策和标准。

原文 · Gary Marcus

Counterpoint: “If alignment issues are becoming big enough that OpenAI is willing to commit 20% of r...

Counterpoint: “If alignment issues are becoming big enough that OpenAI is willing to commit 20% of research inference compute to chain-of-thought monitoring [suggesting] that suggests that alignment issues are becoming a pretty serious concern” we need to invest more heavily in alternatives to LLMs because LLM-centered architectures are failing to yield alignment. I don’t know how much more evidence we need for that. (but yes, we also do need coherent policies, as @emollick rightly suggests) Ethan Mollick @emollick If alignment issues are becoming big enough that OpenAI is willing to commit 20% of research inference compute to chain-of-thought monitoring, that suggests that alignment issues are becoming a pretty serious concern. We really need universal policies & standards across labs. 🔗 View Quoted Tweet 💬 6 🔄 4 ❤️ 32 👀 5724 📊 8 ⚡