Chatbot Arena votes show users rate frozen models more harshly over time
Static rankings on human-preference benchmarks may hide a moving baseline: voter tolerance is shrinking even when models are identical. Teams that track model quality via Chatbot Arena or run their own human evals should segment results by time period before drawing conclusions. The stability of relative rankings versus the rise in negative votes is also useful evidence for anyone designing preference-based leaderboards or RLHF data pipelines.