这篇论文为设计更可靠的Human-AI协作系统提供了理论基石，做AI系统设计或人机交互研究的团队值得关注，能帮你理解校准假设如何影响团队决策的可靠性。
这篇论文从统计校准的角度研究人类与AI的团队协作模型。假设团队由AI模型和人类组成，两者都基于特征空间的某种划分进行了校准，论文揭示了校准假设如何影响团队协作框架。研究考虑了两种框架：一是结合人类和模型的预测，二是将预测责任委托给人类或模型。理论和实验结果表明，现有的组合方法无法保持人类的校准程度；而委托方法虽然保留了预测者的校准，但将负担转移到了决定谁预测的拒绝元模型上。拒绝元模型需要足够精细的校准以定位每个成员的优越区域，这种需求随着人类专业知识的增加而增长，当人类依赖系统无法观察的信息时，这种校准变得不可实现。
Human-AI Teaming Through the Lens of Calibration
We study models for human-AI teaming through the lens of statistical calibration. We assume the team consists of an AI model and human -- both of which are calibrated with respect to some partitioning of the feature space -- and expose how the calibration assumptions propagate into the teaming framework. In particular, we consider frameworks that either (i) combine human and model predictions or (ii) delegate prediction responsibility to either a human or model. We show via theoretical and empirical results that existing methods for combination do not preserve the human's degree of calibration. Methods for delegation (by the very act of delegation) preserve calibration of the downstream predictors but shift the burden onto the rejector meta-model that decides who predicts. The rejector must be calibrated finely enough to locate where each member is superior, a demand that grows with the human's expertise and becomes unattainable when the human relies on information the system cannot observe.