World Labs新出的Atlas能用5张手机照片教会机器人适应新环境，比传统方法快多了。
World Labs联合创始人Justin Johnson介绍Atlas模型，可通过5张手机照片教会机器人在陌生环境中工作。该模型支持实时到模拟再到现实(real-to-sim-to-real)技术，用户上传照片后可生成3D重建空间。整个过程仅需5分钟，用户可通过自然语言描述任务，让智能体构建模拟环境并强化学习微调基础模型。
World Labs co-founder Justin Johnson on how five photos from your phone could teach a robot to work ...
World Labs co-founder Justin Johnson on how five photos from your phone could teach a robot to work in a room it has never seen: "I think there's a couple different tech trees that people are working on. One is this notion of fully in-context learning. Maybe I've got a robotics foundation model, then I can demonstrate to the robot once how a task should be performed, and that's enough for the robot to figure out that task." "Another version is what we're calling real-to-sim-to-real. Maybe I've got my pre-trained robotics foundation model, but I want to adapt it to this particular environment." "Like this studio... You could come in here and take just a couple casual videos with your phone or a couple images with your phone, use Atlas to reconstruct the space, and now stage all kinds of robotics interactions in this studio space in particular." "Literally you could do it in five minutes. Take five photos, upload it to Atlas, have it generate a simulation, describe in natural language what kind of task you want the robot to do, have an agent go build that simulation for you, RL fine-tune your general purpose robotics foundation model, and now you've got a robot... that's perfectly adapted to this space." @jcjohnss on @MTSlive Your browser does not support the video tag. 🔗 View on Twitter World Labs @theworldlabs Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 3 🔄 1 ❤️ 23 👀 6259 📊 4 ⚡