一般凸集上在线库存优化的最优隐藏目标学习

Optimal Hidden-Target Learning for Online Inventory Optimization on General Convex Sets

精选理由

用隐藏目标解决库存优化,有理论保证

AI 摘要

该论文提出一种隐藏目标学习方法用于在线库存优化(OIO),其中基础学习器使用在线梯度下降(OGD)。该方法将已知的遗憾保证从对公共需求概率的逆依赖提升为逆平方根依赖,并证明了匹配下界。对于强凸损失,该方法首次给出poly对数遗憾保证;对于一般凸集,该方法实现了第一个适应欧几里得路径变化的动态遗憾保证。实验在合成和真实库存数据上验证了理论结果。

原文 · arXiv cs.LG

Optimal Hidden-Target Learning for Online Inventory Optimization on General Convex Sets

Online inventory optimization (OIO) is online convex optimization with physical memory: inventory carryover makes the feasible action set depend on the past. A natural principle, used in stochastic inventory learning and recently in OIO under a single linear capacity constraint, is to maintain a hidden target chosen by an online learner and implement its projection onto the currently feasible order-up-to set. We prove that this simple principle is optimal for OIO on arbitrary bounded convex capacity sets. With online gradient descent as the base learner, the method improves the best known regret guarantee for OIO on general convex sets from inverse to inverse-square-root dependence on the common-demand probability, and we prove a matching lower bound. The same principle gives the first polylogarithmic regret guarantee for strongly convex losses and the first dynamic regret guarantee adapting to Euclidean path variation on general convex capacity sets. The analysis introduces a norm alignment principle: the right state variable is the distance from the hidden target to the feasible set, measured in the same norm as the projection. Under norm alignment, this distance evolves pathwise as a scalar queue, with target movement as arrival and common demand as service. This reduction to one-dimensional queue control resolves the state dependence and extends the guarantees to general convex capacity sets, beyond the reach of prior productwise approaches. Experiments on synthetic and real-world inventory data corroborate the theory.