反事实决策中的预测集:覆盖、最优性与共形预测

Prediction Sets for Counterfactual Decisions: Coverage, Optimality, and Conformal Prediction

精选理由

这篇论文解决了决策中如何利用预测不确定性的难题,提出的PC-RACP方法在实验中比现有方法效用更高,值得搞决策优化的同学看看。

AI 摘要

本文提出了一个用于反事实决策中不确定性量化的决策理论框架。它定义了"策略耦合覆盖"——即预测集诱导行动下实现结果的覆盖。该框架证明了一种自然的最大最小规则是分布模糊下的极小极大最优。它提出了一种两阶段过程Policy-Coupled Risk-Averse Conformal Prediction (PC-RACP),在有限样本下逼近最优集。模拟和真实电子邮件营销实验表明,PC-RACP比现有方法提供更高的效用,同时保持有效覆盖。

原文 · arXiv cs.LG

Prediction Sets for Counterfactual Decisions: Coverage, Optimality, and Conformal Prediction

Predictions are increasingly used to guide high-stakes decisions, from treatment selection to policy making. To ensure reliability with imperfect predictions, uncertainty quantification methods such as conformal prediction build prediction sets with coverage guarantees. However, statistical validity alone does not immediately determine the decisions to take, nor the optimality thereof. This gap is especially delicate in counterfactual settings where the outcome that materializes depends on the action taken, so uncertainty cannot be specified independently of the decision rule. We develop a decision-theoretic framework for uncertainty-informed counterfactual decisions. We identify a novel notion of \emph{policy-coupled coverage} -- namely, coverage of the realized outcome under the action induced by the prediction sets themselves -- as the optimal and lossless interface between uncertainty and action. It plays three roles. First, it justifies acting via a natural max-min rule as minimax-optimal under distributional ambiguity. Second, optimizing prediction sets under policy-coupled coverage is equivalent both to a stronger universal-coverage formulation and to the direct risk-averse optimization over policies and utility certificates; this equivalence yields the explicit form of the population-optimal prediction sets. Third, it admits a two-stage procedure, Policy-Coupled Risk-Averse Conformal Prediction (PC-RACP), that approximates these optimal sets with rigorous finite-sample coverage. Simulations and a real email-marketing experiment confirm that PC-RACP delivers higher utility than existing approaches while maintaining valid coverage, and that ignoring the counterfactual structure of the decision problem is suboptimal for both validity and utility.