LMArena 回应质疑:榜首模型在 Factuality 设置下仍居第一
Its leading position on Text Arena is not just about the style. Arena's default ranking already adju...
LMArena 出面回应了榜首模型只靠人设赢投票的说法,解释了 Factuality 排名的具体算法,数据党可以看看。
针对榜首模型只靠文风取胜的质疑,LMArena 表示默认排名已对回答长度和格式做了调整。在开启 Factuality 设置后,榜单会对每条回答中的事实性声明进行核查,并按事实核查得分占 25%、盲测人类投票占 75% 的比例加权。结果显示该模型在 Factuality 设置下仍保持第一。
Its leading position on Text Arena is not just about the style. Arena's default ranking already adju...
Its leading position on Text Arena is not just about the style. Arena's default ranking already adjusts for answer length and formatting. The model also stays #1 with the Factuality setting on, which fact-checks the claims in each answer and blends that accuracy score (25%) with blind human votes (75%). Its distinctive personality wins people over, but the substance underneath holds up too. 💬 0 🔄 0 ❤️ 0 ⚡