DISCO:免扩散分数匹配方法,实现精确条件采样
Diffusion-free Score Matching for Exact Conditional Sampling
这篇论文挺有意思,DISCO 不用扩散那一套时间分数场,单个分数就能做任意条件的精确采样,做生成模型的人可以看看。
arXiv 论文提出 DISCO(DIffusion-free SCOre matching),绕开扩散模型对随时间变化的分数场的依赖。该方法只需估计经过轻微扰动后数据分布的单一分数,即可直接得到精确的条件分数。实验显示 DISCO 在样本质量上与最先进的扩散模型相当,同时能从任意条件分布中准确采样,优于标准启发式采样器。
Diffusion-free Score Matching for Exact Conditional Sampling
The success of modern score-based generative models is largely driven by diffusion-based training, which learns a collection of time-indexed score fields corresponding to progressively noisier versions of the data distribution. While such models achieve impressive sample quality, leveraging them for sound probabilistic inference---particularly sampling from arbitrary conditionals of the model---remains challenging. This difficulty arises because conditioning information is only available for clean data and not for the higher noise levels required to generate exact conditional samples. In this paper, we introduce DIffusion-free SCOre matching (DISCO), a principled approach that sidesteps the need for time-dependent score fields altogether. Our method is based on an objective that, while reminiscent of diffusion-based training, estimates only a single score of the (slightly perturbed) data distribution, for which the exact conditional score is readily obtained. In experiments, DISCO is competitive with state-of-the-art diffusion models in terms of sample quality. More importantly, DISCO yields a more faithful representation of the underlying data distribution and---crucially---enables accurate sampling from arbitrary conditionals, outperforming standard heuristic samplers. This capability opens the door to principled and flexible probabilistic reasoning with score-based models.