多玩家不完美信息博弈中纳什均衡计算的变量界收紧方法

Variable Bound Tightening for Nash Equilibrium Computation in Multiplayer Imperfect-Information Games

精选理由

这篇论文给Gurobi求解多人博弈纳什均衡时加了变量界,让之前一天算不完的三玩家Kuhn扑克能更快解出来,做博弈算法的人可以看看。

AI 摘要

该论文针对多人不完美信息博弈的纳什均衡精确计算问题,基于序列形式的非线性互补问题,使用Gurobi的非凸二次求解器并通过McCormick包络进行空间分支定界。此前该方法无法在24小时内解决完整三玩家Kuhn扑克。本文导出了松弛变量和乘子变量的有限界,从而加强凸松弛,显著提升计算效率。在三人Kuhn扑克实验中验证了该方法的改进效果。

原文 · arXiv cs.AI

Variable Bound Tightening for Nash Equilibrium Computation in Multiplayer Imperfect-Information Games

There has been significant recent progress in algorithms for approximation of Nash equilibrium in large two-player zero-sum imperfect-information games and exact computation of Nash equilibrium in multiplayer strategic-form games. While counterfactual regret minimization and fictitious play are scalable to large games and have convergence guarantees in two-player zero-sum games, they do not guarantee convergence to Nash equilibrium in multiplayer games. Recently, an approach has been presented for exact computation of Nash equilibrium in multiplayer imperfect-information games that solves a quadratically constrained program based on a nonlinear complementarity problem formulation derived from the sequence-form game representation. This formulation was solved using Gurobi's nonconvex quadratic solver, which employs spatial branch-and-bound to iteratively refine variable bounds by solving convex relaxations of bilinear terms via McCormick envelopes. During presolve, Gurobi introduces auxiliary variables and, in some cases, binary variables, leading to an internal MIQCP reformulation. This approach was demonstrated to outperform prior algorithms from the Gambit software suite and quickly solve three-player Kuhn poker after removal of dominated actions; however, the algorithm was not able to solve the full version of the game within 24 hours. In this paper, we derive finite bounds on slack and multiplier variables in the nonlinear complementarity formulation. These bounds strengthen the convex relaxations used within spatial branch-and-bound and lead to substantial computational improvements. We demonstrate the impact of the proposed bounds on exact Nash equilibrium computation in three-player Kuhn poker.