PCM-PPO：面向Titan深空探测器自主任务规划的物理约束强化学习方法
A physics-constrained deep reinforcement learning method for autonomous mission planning of Titan deep space probes
土卫六离地球太远，地面没法实时指挥，这篇论文直接把轨道动力学写进动作掩码里训PPO，探测器自己就能规划任务。做航天GNC或自主系统的工程师值得看看实验和消融部分。
一篇arXiv论文提出PCM-PPO方法，将物理约束引入maskable PPO，用于Titan（土卫六）深空探测器的自主任务规划。由于地球与Titan距离极远，依赖地面在环的连续规划不可行，而面向地球观测场景的既有规划方法对深空不确定条件的泛化能力有限。
技术机制上，论文为Titan任务建立了专门的离散时间马尔可夫决策过程，刻画任务可行性与资源约束；系统动力学与几何模型涵盖中心引力、J2摄动、第三体引力以及下行链路掩星。PCM-PPO通过固定容量的目标池组织预设目标与机会目标，用目标级状态矩阵加全局状态向量表示任务状态；物理约束动作掩码从当前任务状态构造可容许决策域，引导策略学习只做出物理可执行的决策，避免不可行探索。
对比、消融与不确定性实验验证了该方法的有效性。相比纯数据驱动的PPO变体，这种物理先验嵌入方式对深空任务更具可解释性，对航天器GNC与自主系统研发团队有直接参考价值。
A physics-constrained deep reinforcement learning method for autonomous mission planning of Titan deep space probes
Titan is a compelling target for future deep space exploration, while its extreme Earth-Titan distance and complex environment make continuous ground-in-the-loop planning impractical. Existing planning methods, primarily developed for Earth-observation scenarios, have limited generalizability to uncertain deep space conditions and adaptability to time-varying mission states. To address these challenges, this paper proposes a physics-constrained maskable proximal policy optimization (PCM-PPO) method for Titan autonomous mission planning. A Titan-specific discrete-time Markov decision process is established to characterize mission feasibility and resource constraints. A system dynamics and geometric model is incorporated to enhance physical representation, including central gravity, J2 perturbation, third-body attraction, and downlink occultation. To accommodate opportunity targets under a bounded action dimension, PCM-PPO organizes predefined and opportunity targets through a fixed-capacity target pool and represents the mission state with a target-wise state matrix and a global state vector. A physics-constrained action mask constructs an admissible decision domain from current mission states, guiding policy learning toward physically executable decisions and avoiding infeasible exploration. An integrated training strategy facilitates policy optimization under coupled constraints. Comparative, ablation, and uncertainty experiments validate the effectiveness of PCM-PPO. PCM-PPO provides a feasible and interpretable scheme for autonomous mission planning of Titan deep space probes.
This report is categorized under AITOP's "Papers" desk. Key entities and technical topics under continuous tracking include PCM-PPO, PPO, 强化学习, 深空探测.
Source attribution: curated from arXiv cs.AI (@Hanmin Li, Tao Wang, Shuangliang Liu, Zhe Zhang, Maodeng Li).