nuance_ai 发布 Emma：基于 Nuplex 的全双工视听对话模型
It's honestly surprising how good this tech is getting. Emma listens and reacts while you are stil...
nuance_ai 做了个叫 Emma 的 AI 角色，能在你话说一半时就点头接话，还用表情提示轮到她。跟 Siri 那种等你说完才回的产品完全不同，底层的 Nuplex 是全双工视听模型。做语音交互、数字人产品的开发者可以看看这条演示视频。
nuance_ai 经过 18 个月研究推出 Emma，一个能实时听、实时反应的 AI 角色，底层是他们的全双工视听基础模型 Nuplex。区别于多数等你讲完才开口的语音助手，Emma 能在你还在说话时就给出反应，并通过视觉线索（表情、动作）提示轮到她说话。Nuplex 同时处理音频和视频双通道输入输出，官方称对话时机接近与真人交谈。
这类全双工（full-duplex）架构是当前语音交互的关键方向，普通语音助手采用轮次切换，等待对方说完再处理，会有明显延迟感；全双工模型则持续监听并即时反馈，更接近面对面交流的节奏。加入视觉模态后，轮次切换不再只靠音频判断，还能用面部表情作为信号，减少打断和尴尬停顿。
It's honestly surprising how good this tech is getting. Emma listens and reacts while you are stil...
It's honestly surprising how good this tech is getting. Emma listens and reacts while you are still talking, and she uses visual cues to signal when it is her turn. The conversation timing feels close to talking with a person. It's built on Nuplex, their full-duplex audiovisual foundation model. Fangchang Ma @fangchangma The first AI persona you’ll actually want to meet face-to-face. Most AI personas stare blankly while you talk. Emma reacts while you’re still speaking. After 18 months of research at @nuance_ai , this is Emma, built on Nuplex, our full-duplex audiovisual foundation model.
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Nuplex, nuance_ai, 全双工, 多模态.
Source attribution: curated from elvis (@omarsar0). Cross-source corroboration: 2 independent sources have covered this development (including rohanpaul_ai), confirming industry-wide signal strength.
- rohanpaul_ai19:57原文
