LMArena open-sources two web development evaluation datasets
Preference data of this scale for web app generation is scarce, and the pairing of subjective preference labels with verified functional requirements gives training and evaluation teams two complementary signal types. Model developers working on coding agents can benchmark against human judgment rather than proxy metrics. Comparison with existing web-dev benchmarks becomes straightforward since both datasets and the accompanying paper are public.
