想理解AI在空管这种高风险场景怎么解释自己?这篇论文用显著图告诉你智能体为什么选择某条航线,很实在。
该论文探索可解释强化学习(RL)在空管(ATC)中的应用。研究人员在简化ATC环境中训练RL智能体,使其决策替代航线以规避禁飞区。他们采用显著图分析输入特征对智能体决策的影响,揭示关键因素。
Explainable Reinforcement Learning for assisting Air Traffic Controllers
To effectively integrate AI into high-stakes, critical environments such as healthcare, autonomous driving, and aviation--and to advance toward higher levels of automation and seamless human-AI collaboration--building trust in AI-driven solutions is essential. Trust, in turn, is closely linked to the explainability of AI systems. The rapid advancements in AI across various domains have underscored the challenges of establishing trust, raising increasing interest in AI explainability even more when applied to deep learning. In this context, the present work aims to explore the application of explainability techniques to Reinforcement Learning (RL) algorithms, specifically within the safety-critical domain of Air Traffic Control (ATC). Using a simplified ATC environment as an initial testbed, an intelligent agent is trained with a reinforcement learning algorithm to make decisions on alternative flight routes that avoid no-fly zones. As a preliminary explainability approach, a saliency map is employed, providing insights into the input features that most significantly influence the agent's decision-making process.