#user preferences

3 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "user preferences", newest first.
Nov 14
PapersBuildersSelected00:12
Chatbot Arena votes show users rate frozen models more harshly over time

Static rankings on human-preference benchmarks may hide a moving baseline: voter tolerance is shrinking even when models are identical. Teams that track model quality via Chatbot Arena or run their own human evals should segment results by time period before drawing conclusions. The stability of relative rankings versus the rise in negative votes is also useful evidence for anyone designing preference-based leaderboards or RLHF data pipelines.

rohanpaul_ai@rohanpaul_aiSource
Jun 27
Jun 5