苹果终于用视觉LLM绕开了应用适配难题，做iOS开发或关注AI助手的开发者值得关注，新Core AI库也让本地模型部署更简单。
苹果在WWDC 2026上发布了新版Siri AI，采用基于Gemini的定制模型，运行在私有云上。新Siri利用视觉大模型从用户屏幕提取信息，无需应用单独适配。苹果还推出了Core AI库，支持PyTorch模型在苹果硬件上运行。iOS 27开发者测试版已包含新功能，但需排队等待使用。
Siri AI at WWDC 2026
Given how badly burned anyone who took Apple's 2024 WWDC Apple Intelligence announcements at face value was, I'm holding to a strict "I'll believe it when I see it" policy for everything they announced today . The new Siri AI features do at least look feasible with today's technology, especially since Apple are licensing a custom Gemini-derived model that they can run on their own Private Cloud Compute. It sounds like they'll be taking advantage of vision LLMs to extract information from the user's screen, which neatly sidesteps the need for every existing application to ship custom code in order to integrate with Apple Intelligence. Vision LLMs were a much less mature category in June 2024. The new Core AI library looks like a good step in enabling developers to finally take full advantage of Apple's hardware for running their own models. It integrates with Meta's open source PyTorch ecosystem, based on these Core AI PyTorch extensions : Core AI PyTorch Extensions ( coreai-torch ) is a Python package that bridges PyTorch and Core AI. You can use it to bring up an existing PyTorch model — exported as a torch.export.ExportedProgram — into a Core AI AIProgram ready to run on Apple hardware, traversing the FX graph node-by-node and mapping ATen operators to Core AI operations. You can install an iOS 27 Developer Beta today, which supposedly has the new features - but you then have to make it through a waiting list for access to the new Siri AI. Aaron Perris from MacRumors reports having made it off the waitlist so we may start seeing credible reports on how well Siri AI works in the very near future. Tags: vision-llms , apple , generative-ai , ai , llms