GenStream框架实现视频流带宽压缩99.9%
GenStream: Semantic Streaming Framework for Generative Reconstruction of Human-centric Media
朋友推荐：这个GenStream框架很酷，它用新方法压缩视频流，能节省大量带宽，特别适合体育和表演类视频。
GenStream是一种语义流式框架，用于生成式重建以人为中心的媒体。它通过将密集视频帧替换为紧凑的语义元数据来工作，包括骨骼关键点、相机视角参数和静态3D背景模型。这些元素传输到客户端后，由生成模型重建出逼真的人类形象并合成到原始视角的3D场景中。该框架在奥运花样滑冰片段上部分验证，实现了HEVC的99.9%带宽压缩。
GenStream: Semantic Streaming Framework for Generative Reconstruction of Human-centric Media
Video streaming dominates global internet traffic, yet conventional pipelines remain inefficient for structured, human-centric content such as sports, performance, or interactive media. Standard codecs re-encode entire frames, foreground and background alike, treating all pixels uniformly and ignoring the semantic structure of the scene. This leads to significant bandwidth waste, particularly in scenarios where backgrounds are static and motion is constrained to a few salient actors. We introduce GenStream, a semantic streaming framework that replaces dense video frames with compact, structured metadata. Instead of transmitting pixels, GenStream encodes each scene as a combination of skeletal keypoints, camera viewpoint parameters, and a static 3D background model. These elements are transmitted to the client, where a generative model reconstructs photorealistic human figures and composites them into the 3D scene from the original viewpoint. This paradigm enables extreme compression, achieving over 99.9% bandwidth reduction compared to HEVC for the continuous data stream. We partially validate GenStream on Olympic figure skating footage and demonstrate potential for high perceptual fidelity under minimal data. While acknowledging the significant computational costs shifted to the client and challenges in generalization, GenStream opens new directions in volumetric avatar synthesis, canonical 3D actor fusion across views, and personalized viewing experiences, laying the groundwork for scalable, intelligent streaming in the post-codec era.