模拟硬件跑生成模型能耗低两数量级,AIS框架在MNIST上FID仅27.6,比之前好3-4倍,适合低功耗场景。
模拟硬件(如耦合振荡器)能耗比数字计算低两个数量级,但物理方程限制无法直接运行现代生成模型。该文提出Analog Interaction Systems(AIS)框架,利用时变分段参数和隐藏物理状态两种机制缩小表达差距,并采用Wasserstein GAN训练。在MNIST和Fashion-MNIST上,基于振荡器的AIS分别取得FID 27.6和80.8,比此前最优模拟硬件生成模型提升3-4倍。能量估算为每张生成图像23μJ,较数字基线降低约100倍。
Generative Models on Analog Hardware with Dynamics
Analog hardware platforms such as coupled oscillators and Analog Ising Machines naturally solve differential equations at a fraction of the energy cost of digital computation, making them attractive for low-power generative modeling, yet a fundamental mismatch exists: modern generative models assume flexible, software-defined dynamics, whereas analog hardware imposes fixed, physics-determined differential equations with limited approximation capacity. This paper introduces Analog Interaction Systems (AIS), a unified framework for hardware-implementable dynamical systems, and empirically characterizes their expressivity gap relative to neural network baselines. Two hardware-compatible mechanisms are proposed to narrow this gap - time-varying piecewise parameters and hidden physical states - and a Wasserstein GAN training procedure is developed to enable training of these models without requiring them to follow a specific trajectory. We characterize how area and power scale with connection density and precision, showing that sparse connectivity and low-bit-width quantized parameters are necessary for practical implementation, and estimate an energy cost of 23uJ per generated image for the chosen architecture, representing a 2-orders-of-magnitude improvement over digital baselines. On MNIST and Fashion-MNIST, our oscillator-based AIS achieves FID scores of 27.6 and 80.8, outperforming the best prior hardware-implementable analog generative models by 3-4x with a 4-bit sparse architecture.