想测强化学习在硬核动作游戏里的极限?DSLE把黑暗之魂Boss战变成基准,PPO和DQN连教程Boss都打不过,看看专家系统怎么赢的。
DSLE是一个容器化平台,将《黑暗之魂:重制版》的22个Boss战作为Gymnasium风格基准。DSLE-5子集包含5个代表性Boss,用于评估随机策略、专家系统、进化基线和PPO/DQN智能体。专家系统和进化基线分别以63%和43%的胜率击败教程Boss,但其他方法均未击败其余Boss。PPO和DQN在教程Boss上胜率最高仅0.33%,其余为0%。研究通过生存时间和伤害量报告失败案例。
DSLE: A Learning Environment for Dark Souls Boss Encounters
We introduce the Dark Souls Learning Environment (DSLE), a containerized platform that presents all 22 boss encounters of Dark Souls: Remastered as game-playing agent benchmarks through a Gymnasium-style interface. DSLE combines real-time combat, high-dimensional visual input, and sparse terminal rewards, with each environment step being a real action executed against the running game. To support controlled comparison, we define DSLE-5, a representative five-boss subset, spanning a melee fight, a spatially constrained arena, an environmental-hazard fight, a multi-target fight, and a fast final-boss fight, that we recommend as the starting suite for agents built on DSLE. On DSLE-5 we evaluate a random policy, an expert system, an evolutionary baseline, and PPO and DQN agents trained from visual input. The expert system and the evolutionary baseline each defeat the Asylum Demon, the game's tutorial boss (63% and 43% peak win rates), but none of the five methods defeats the other four DSLE-5 bosses; PPO and DQN show no measurable learning (at most 0.33% win rate on the tutorial boss, 0% elsewhere) within a budget that already costs tens of wall-clock hours per run. A broader study running the evolutionary baseline across all 22 encounters under advantaged all level-50 stats yields wins on only a handful of additional early-game bosses and leaves the rest unwon. The failure cases range from sub-10-second deaths in cramped, multi-target encounters to minute-long stalemates that inflict almost no damage, and we report them through survival time and damage dealt rather than win rate alone.