LiveKit Agents推出Expressive mode,Fish Audio S2.1 Pro自动生成情绪标签

Every serious TTS ships emotion tags like [whispering] [laugh] [excited]. Almost nobody uses them - ...

精选理由

LiveKit给语音代理加了个情绪开关,让AI说话不再一个调,配合Fish Audio S2.1 Pro自动生成表情,想试的可以直接开。

AI 摘要

LiveKit Agents今日发布Expressive mode,解决语音代理语气单一的问题。该模式由LLM自动在文本中写入情绪标签,如[whispering]、[laugh]、[excited],再由Fish Audio S2.1 Pro渲染成相应语音。用户只需在LiveKit Agents中切换一个开关即可启用,无需手动编写情绪提示词。此功能让语音代理能根据对话内容动态调整语气,比如在播报坏消息时不再使用欢快腔调。

原文 · Fish Audio

Every serious TTS ships emotion tags like [whispering] [laugh] [excited]. Almost nobody uses them - ...

Every serious TTS ships emotion tags like [whispering] [laugh] [excited]. Almost nobody uses them - nobody wants to prompt-wrangle prosody. Expressive mode fixes that: the LLM writes emotion inline, Fish Audio S2.1 Pro renders it, one toggle in @livekit Agents. Congrats to the LiveKit team on the launch! And proud of the collaboration that made this sing. 🐟 LiveKit @livekit 1/ Today we're launching Expressive mode in LiveKit Agents. Most voice agents deliver every sentence in that same, upbeat register we all know and hate (including bad news). Expressive mode makes your agent sound like it registers what the caller is actually feeling. Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 1 👀 145 ⚡