杨植麟从Transformer-XL、XLNet到Kimi K3，只用16个专家就做到1M上下文，值得看看他的思路。
Moonshot AI 创始人兼CEO杨植麟在GTC 2026介绍其学术生涯。他曾在清华、卡内基梅隆大学求学，并在Meta AI、Google Brain工作，与Yoshua Bengio和Yann LeCun合作。其早期论文XLNet被引用超过10,000次。第三代模型Kimi K3加入原生视觉能力，支持1M-token上下文，仅使用16个活跃专家。
源：https://t.co/Ssw3CWI4SA
源： x.com/rohanpaul_ai/s… Rohan Paul @rohanpaul_ai This is Moonshot AI/Kimi K3's founder & CEO Yang Zhilin at GTC 2026 The 34-year-old researcher studied at Tsinghua, then earned his Carnegie Mellon Ph.D. Then he worked with Jason Weston at Meta AI and Quoc Le at Google Brain. His work also connected him to Yoshua Bengio and Yann LeCun on the topics of reasoning and representation. Eventually, Yang returned to China and co-founded Moonshot AI in Beijing a few years later. His earlier Transformer-XL and XLNet work addressed how language models forget distant context. Moonshot AI carried that research focus forward through Kimi K2’s 1T-parameter mixture-of-experts design. XLNet, was later cited more than 10,000 times and is still his best-known academic paper. Kimi K3 expands the formula with native vision, 1M-token context, and only 16 active experts. His career has become a textbook example of how quickly global research networks can reshape the way countries compete in AI. ---- From "Kimi AI" YouTube channel, (full video link in comment) Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 0 👀 377 ⚡