这篇论文搞了个标准协议EPC，专门用来测LLM代理系统里评估器偏好怎么耦合的，还附带了GPT-4o、Qwen、DeepSeek等8个评估器的大规模实测数据，方便你复现和对比。
该论文提出了EPC（评估者偏好耦合）协议，这是一种RFC风格的标准化协议，用于隔离和测量LLM代理系统中评估者偏好动态的四个阶段。协议包含了执行器和评估器配置、策略与任务设计、TTRL更新规则以及gamma、JSD、ECE、Brier等度量指标的计算方法。同时发布版本化的参考快照v1.0，包含GPT-4o、Qwen、DeepSeek等八个评估器条件的122次独立实验重复测量结果，并标注了版本标识符、API端点与测量日期。该协议、参考快照及实现代码已作为开放基础设施发布，旨在支持第三方复现、跨评估器比较以及检测专有评估器无声更新导致的测量衰减。
EPC: A Standardized Protocol for Measuring Evaluator Preference Dynamics in LLM Agent Systems
When LLM agents use evaluator feedback to adapt their behavior in closed loops, evaluator biases propagate through the agent's strategy distribution -- a phenomenon known as evaluator preference coupling. Prior work has documented coupling across multiple evaluator families and model versions, but the field lacks a standardized protocol that enables third-party researchers to (i) reproduce coupling measurements, (ii) compare results across evaluators and time points, and (iii) detect measurement decay as proprietary evaluators silently update. This paper provides the protocol. We specify EPC (Evaluator Preference Coupling) -- a detailed, RFC-style protocol specification for the four-phase isolation paradigm, covering executor and evaluator configuration, strategy and task design, the TTRL update rule, metric computation (gamma, JSD, ECE, Brier), and output schema. We accompany the protocol with a versioned Reference Snapshot v1.0: coupling measurements for eight evaluator conditions (N=122 unique experimental repetitions across GPT-4o, Qwen, DeepSeek, and others) derived from five independent studies, annotated with evaluator version identifiers, API endpoints, and measurement dates. The snapshot is explicitly time-bound: all values are conditional on specific model versions and are expected to decay as proprietary evaluators update. We define a versioning convention (vX.Y-Z, encoding protocol version, snapshot version, and evaluator generation) and provide a usage guide covering adoption, interpretation, and known pitfalls. The protocol, reference snapshot, and implementation code are released as open infrastructure.