论文精选

Neil Movva谈AI芯片与架构

One of the best recent podcasts on AI. Neil has a gift for explaining all of the jargon and insights...

精选理由

想了解AI芯片领域的专家观点?听听前Nvidia工程师Neil Movva的最新播客,深入浅出,收获满满!

AI 摘要

Neil Movva,前Nvidia工程师,现任Sail Research公司CEO,在最新播客中详细解析了AI芯片的各个层面,包括延迟与吞吐量、芯片定价、内核工程、新型芯片架构等。播客内容深入浅出,适合AI领域专业人士学习。

原文 · Naval

One of the best recent podcasts on AI. Neil has a gift for explaining all of the jargon and insights...

One of the best recent podcasts on AI. Neil has a gift for explaining all of the jargon and insights simply. (I’m not involved, just found it unusually educational). Patrick OShaughnessy @patrick_oshag Neil Movva ( @neilmovva ) started his career at Nvidia, working on GPUs and kernels, and has an unusually deep understanding of inference, from software to chips to power. We spend a lot of time on each of those layers, how they connect, and where the important tradeoffs are. What makes this conversation special is how detailed it is (like a 401-level class), yet Neil makes it remarkably clear and easy to follow. Today he runs Sail Research, a company building infrastructure for agents to make tokens as cheap as possible. We discuss: - Latency versus throughput - Why there are no bad chips, only bad pricing - The end of kernel engineering - Buying chips and power no one else wants - New chip architectures - Nvidia lore + his contrarian view of the company - Open source and the frontier labs I learned a ton. Enjoy! TIMESTAMPS 0:00 Intro 0:38 Building a “Token Factory” 4:21 The Future of Background Agents 13:09 Nvidia and the GPU Stack 23:27 Chips, Memory, and Transformers 36:14 The Future of AI Training Data 44:32 Chip Scarcity and Compute Arbitrage 52:44 Reinventing the AI Data Center 59:01 Power and the “Scavenger Strategy” 1:10:10 Open vs. Closed AI Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 46 🔄 209 ❤️ 2207 👀 218422 📊 511 ⚡