Neil Movva AI Podcast
Offers deep technical insights into AI infrastructure and chip economics from a former Nvidia engineer now building agent infrastructure.
Neil Movva, founder of Sail Research, discusses AI infrastructure in a detailed podcast. The conversation covers inference layers from software to chips, latency versus throughput, and chip pricing strategies. Movva shares his contrarian views on Nvidia and explores new chip architectures and the future of AI training data.
One of the best recent podcasts on AI. Neil has a gift for explaining all of the jargon and insights simply. (I’m not involved, just found it unusually educational). Patrick OShaughnessy @patrick_oshag Neil Movva ( @neilmovva ) started his career at Nvidia, working on GPUs and kernels, and has an unusually deep understanding of inference, from software to chips to power. We spend a lot of time on each of those layers, how they connect, and where the important tradeoffs are. What makes this conversation special is how detailed it is (like a 401-level class), yet Neil makes it remarkably clear and easy to follow. Today he runs Sail Research, a company building infrastructure for agents to make tokens as cheap as possible. We discuss: - Latency versus throughput - Why there are no bad chips, only bad pricing - The end of kernel engineering - Buying chips and power no one else wants - New chip architectures - Nvidia lore + his contrarian view of the company - Open source and the frontier labs I learned a ton. Enjoy! TIMESTAMPS 0:00 Intro 0:38 Building a “Token Factory” 4:21 The Future of Background Agents 13:09 Nvidia and the GPU Stack 23:27 Chips, Memory, and Transformers 36:14 The Future of AI Training Data 44:32 Chip Scarcity and Compute Arbitrage 52:44 Reinventing the AI Data Center 59:01 Power and the “Scavenger Strategy” 1:10:10 Open vs. Closed AI Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 46 🔄 209 ❤️ 2207 👀 218422 📊 511 ⚡
