Runway发布GWM Worlds 2通用世界模型

Today, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates int...

精选理由

Runway的新模型GWM Worlds 2能生成720p实时交互视频,支持文本控制,比传统视频生成更灵活自由。

AI 摘要

Runway发布了GWM Worlds 2通用世界模型,可生成720p分辨率、24fps的连续交互式实时模拟视频,并配备48000Hz音频。该模型基于音频视觉生成基础模型构建,允许用户定义环境、主体、视觉风格、物理规则和氛围。用户可通过文本指令控制场景中的任何主体或整个场景,配合连续相机运动,世界会根据每次新输入持续发展,无预设长度限制。

图片来源 · Runway ML
原文 · Runway ML

Today, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates int...

Today, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below. Your browser does not support the video tag. 🔗 View on Twitter 💬 7 🔄 11 ❤️ 57 👀 4481 📊 16 ⚡