Vidu S2 发布实时可编辑空间视频生成模型
Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation
Vidu S2 能实时生成和编辑 720p 视频流,比之前的 Vidu S1 更强,支持换装、换背景等操作。
Vidu S2 包含 Vidu S2-Avatar 和 Vidu S2-Editing 两个模型。Vidu S2-Avatar 支持 720p 实时视频生成和动态更新,比上一代 Vidu S1 更强。Vidu S2-Editing 可实时编辑视频流,实现风格渲染、换装、换背景等功能。实验表明其性能优于所有基线模型。
Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation
We present Vidu S2, which comprises Vidu S2-Avatar, a real-time interactive digital-character model, and Vidu S2-Editing, a real-time video editing model. Moreover, we explore the feasibility of real-time spatial video generation for both Vidu S2-Avatar and Vidu S2-Editing. Compared with Vidu S1, Vidu S2-Avatar supports real-time 720p video generation, generation with dynamic references that can be updated at any moment, and stronger instruction following, such as dancing. Vidu S2-Editing supports editing a video stream in real time, including style rendering, clothing replacement, character replacement, and background replacement. Experiments show that Vidu S2 outperforms all baselines. A playable online demo is available at https://vidu.com/vidu-stream.