产品多源确认精选

VoiceArena 推出 Diarization Bench,同规则评测 12 款说话人分离系统

精选理由

VoiceArena 搞了个 diarization 评测榜,12 款系统同题同规则比拼,还能看时间容差一变分数差多大,做语音的可以去看看。

VoiceArena 发布 Diarization Bench,用同一批真实音频和统一打分规则对比 12 款 diarization(说话人分离)系统。基准显示,重叠语音和说话人数量增加时,各系统准确率下降明显。评测还揭示 collar(时间容差)对得分的影响:NVIDIA Nemotron 3 在 250 ms collar 下 DER 为 4.29%,同一输出按 0 ms collar 评分则升至 14.72%。该基准补充了 VoiceArena 已有的 STT、TTS 和对话智能体评测。

原文 · rohanpaul_ai

VoiceArena launched Diarization Bench to compare 12 diarization systems on the same real-world audio and scoring rules. It exposes how quickly accuracy drops with overlap and more speakers.

STT, TTS, conversational agents, and now diarization, all on @voicearena_ai

The number that got me is the collar effect: the collar is simply the timing tolerance around a speaker change.

NVIDIA Nemotron 3 scores 4.29% DER with a 250 ms collar. Score the exact same output at 0 ms and it becomes 14.72%.