PRISM这篇不用GAN也能做图像翻译,用一个门控控制改哪些部分,五个基准上赢了四个,挺实用的。
PRISM是一种无GAN的流匹配框架,用逐特征门控取代全局噪声控制,决定每张图像要改什么、留什么。门控的空间先验来自源特征到目标特征分布的标准化距离,特征远离目标分布时被放开,接近时则保留。在AFHQ猫到狗、CelebA-HQ外观迁移、昼夜重打光、虚拟染色和乳腺冷冻到永久病理五个基准上,PRISM在四个基准上获得最佳Inception FID和KID,第五个也接近最优。在组织病理学任务中,它的细胞核计数比最接近理想值,兼顾了目标真实感与结构保留。
PRISM: Distribution-Gated Flow Matching for Controllable Unpaired Image Translation
Unpaired image-to-image translation must decide, per image, what to change and what to preserve without paired supervision. Many diffusion-based unpaired translators control preservation through a single global noise or guidance value applied across the image, which cannot separate content to keep from appearance to change. We present PRISM, a GAN-free flow-matching framework that replaces this global control with a learned per-feature gate. The gate's spatial prior is derived from each source feature's standardized distance to the target feature distribution, so features far from the target are freed while target-consistent features are preserved. The same gate controls both the initialization, which mixes the real source latent with a task-matched corruption, and the transport timing during Ordinary Differential Equation (ODE) integration. The corruption is matched to the task, content-anchored (AdaIN) for structure-preserving translation and partially anchored for structure-changing translation, and the gate can be overridden locally at inference from text or a detector without retraining, preserving important structures of the original image while still generating realistic results. We evaluate PRISM on five natural and biomedical benchmarks (AFHQ cat->dog, CelebA-HQ appearance translation, day->night relighting, virtual staining, and breast frozen->permanent histopathology). Among the evaluated methods under a shared same-split protocol, PRISM attains the best Inception FID and KID on four benchmarks and a competitive result on the fifth, and on histopathology yields the nuclei-count ratio closest to the ideal, supporting a favorable balance between target realism and structural preservation.