论文

异构异步多玩家多臂老虎机:最优分配NP难,贪心算法达1/√e近似

Approximating Optimal Policies in Heterogeneous Asynchronous Multi-player Bandits

精选理由

做在线学习或频谱调度的人看:异构多玩家老虎机最优分配是NP难,贪心就有1/√e近似,可当基线用。

一篇arXiv论文研究异步多玩家多臂老虎机(MMAB)中玩家激活概率各不相同的异构情形,该设定更贴近认知无线电网络中设备并非始终在线的现实。论文首先证明在异构设定下计算最优分配是NP难问题。随后证明多项式时间运行的贪心算法能达到最优分配的1/e近似,若按激活概率从高到低处理玩家,近似保证提升至1/√e。作者将贪心算法定位为设计异构异步MMAB在线算法时的实用oracle基线。

原文 · arXiv cs.LG

Approximating Optimal Policies in Heterogeneous Asynchronous Multi-player Bandits

Motivated by applications to cognitive radio networks, multi-player multi-armed bandits (MMAB) have attracted considerable attention in recent years. The asynchronous variant, in which players are active only at a fraction of timesteps, better reflects real-world decentralized networks, where devices are not permanently active. Despite its practical relevance, this setting remains relatively understudied. Existing work on asynchronous MMAB has focused on homogeneous players, who share the same activation probability, a setting in which the optimal centralized allocation can be easily characterized. In contrast, efficiently computing the optimal allocation in the heterogeneous setting, where players have different activation probabilities, has remained an open problem. In this work, we investigate this problem and first establish its NP-hardness. We then turn to the greedy algorithm, which runs in polynomial time, and prove that it achieves a $\frac{1}{e}$-approximation of the optimal allocation. Furthermore, when players are processed in decreasing order of their activation probabilities, the approximation guarantee improves to $\frac{1}{\sqrt{e}}$. Overall, our results establish the greedy algorithm as an efficient approximation to the optimal allocation, providing a practical oracle baseline for the design of online algorithms for heterogeneous asynchronous multi-player bandits.