这篇论文讲了算法追责如果不考虑因果,用户容易钻空子,用因果框架能让系统更稳定,值得搞机器学习的人看看。
本文提出一种因果执行框架,建模追责行为通过结构因果模型传播以及对真实标签的影响。该框架将追责策略优化转化为非凸问题,并给出可高效计算的稳定均衡条件。在半合成和真实信用数据集上的实验表明,忽略因果结构的追责会诱导大规模错位行为,而因果追责能减少博弈激励并降低重复训练需求。与标准经验风险最小化相比,该方法在预测一致性上持续更优。
The Role of Causality in Algorithmic Recourse
Algorithmic recourse aims to provide individuals with actionable changes to improve their predicted outcomes in high-stakes classification settings, such as loan and mortgage applications. However, most existing approaches focus only on flipping a model's prediction, without accounting for whether the recommended changes lead to genuine improvement in an individual's true qualifications or merely enable strategic gaming of the classifier. Consequently, deployed recourse policies can induce behavioral responses that degrade predictive accuracy and become ineffective after model retraining. In this work, we formalize this failure mode through a causal performative framework for recourse. We model how recourse actions propagate through a structural causal model, capturing interactions among features as well as their effect on the true label. These causal responses induce a non-convex optimization problem, even under standard convex losses. We characterize conditions under which performatively stable solutions exist and can be efficiently computed via simple iterative dynamics. Our analysis reveals that recourse policies that ignore causal structure can induce large, misaligned behavioral responses, whereas causal recourse leads to stable equilibria that reduce incentives for gaming. Experiments on both semi-synthetic and real credit datasets demonstrate that our approach consistently outperforms standard empirical risk minimization while reducing the need for repeated model retraining to accommodate distribution shifts caused by strategic agent behavior.