Primary sourceGorden Sun
View sourceEvent ·Multi-source
NVIDIA开源PixelUMM:一个模型同时支持图文和视频的理解与生成
NVIDIA开源了无编码器多模态模型PixelUMM,一套架构同时处理图像和视频的理解与双向生成。它去掉了传统独立的视觉编码器,把画面切分成像素块直接送入主模型,让输入理解和输出生成共用同一套底层表示。这种设计简化了多模态流程,模型和权重已完整开源。
Current read
NVIDIA把PixelUMM开源了,一个模型搞定图文视频的理解和生成,做法是不用视觉编码器直接吃像素块,搞多模态研究的可以看看源码。
11 sources71° AI heatLast updated 2026/10/5 12:03:38
Evidence
11 sourcesRelated source 1kimmonismus
View sourceRelated source 2techcrunch
View sourceRelated source 3The Business Times: Tech
View sourceRelated source 4The Straits Times: Business
View sourceRelated source 5marktechpost
View sourceRelated source 6NVIDIA AI
View sourceRelated source 7Justine Moore
View sourceRelated source 8Tech in Asia
View sourceRelated source 9Nathan Lambert
View sourceRelated source 10PyTorch
View sourceConflict check
Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.