Google DeepMind发布Project Genie,用街景生成交互式360度虚拟世界

Step into the map with the Street View grounding feature in Project Genie from @GoogleDeepmind and @...

精选理由

Google DeepMind搞了个Project Genie,能直接用街景数据生成360度虚拟世界,你输个地址就能进去探险,挺酷的。

AI 摘要

Google DeepMind在I/O大会上展示了Project Genie研究原型,利用Google Maps Street View数据作为基础,用户可通过文本提示或真实地点生成并探索360度交互式虚拟环境。该模型解决了“空白空间”问题,基于用户动作和世界描述逐帧预测后续画面,实现动态场景模拟。例如可模拟游过海洋或登上山顶的体验,标志着交互式媒体和模拟管道的重大转变。

图片来源 · Google AI
原文 · Google AI

Step into the map with the Street View grounding feature in Project Genie from @GoogleDeepmind and @...

Step into the map with the Street View grounding feature in Project Genie from @GoogleDeepmind and @GoogleLabs . Announced at I/O, this research prototype uses locations from @GoogleMaps Street View as a foundation, letting you generate and explore interactive, 360-degree virtual environments from just a text prompt or real-world starting place. Cool, right? But… How does it actually work? 🤔 As an experimental tool, Project Genie tackles the "blank space" problem (showing both what’s in front of the camera and behind it) by utilizing Street View data to realistically generate a 360-degree view of the location you selected as the starting point for your world to generate from. Worlds generated by Genie are far more dynamic and rich because they’re created frame-by-frame based on the world description and user actions. By predicting each subsequent frame, Genie is able to simulate what it looks like to swim across an ocean, or hike to the top of a peak, marking a massive shift in interactive media and simulation pipelines. What real-world place would you want to step into and explore? Your browser does not support the video tag. 🔗 View on Twitter 💬 17 🔄 28 ❤️ 184 👀 23800 📊 39 ⚡