World Labs团队发布了Atlas,首个多模态世界模型,能从单张图重建3D场景,还能模拟时空,比现有模型更精确。
Atlas是首个从头开始训练的多模态世界模型,能实现像素级精确相机控制的帧生成。该模型可从单张输入图像重建大型场景,通过重新构架视频模拟时空,并能从一个或多个输入图像原生输出3D空间。Atlas是目前最好的相机条件世界模型,为从视觉效果到机器人学的多种应用场景开辟可能性。
I'm so excited that our @theworldlabs team has achieved a major milestone today! Introducing Atlas ...
I'm so excited that our @theworldlabs team has achieved a major milestone today! Introducing Atlas - a first of its kind multimodal world model trained from scratch! 🚀 Atlas is capable of generating frames with pixel-perfect camera control, reconstructing large scenes from as few as one single input image, simulating space-time by reframing videos, natively outputting 3D spaces from one or more input images, composing multiple posed images into a consistent 3d world, and more! This is the best camera conditioned world model ever, opening doors to many possible use cases from VFX to robotics. I'm so so so proud of our team!♥️ World Labs @theworldlabs Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 61 🔄 152 ❤️ 1550 👀 115852 📊 211 ⚡