GARI:生成器对齐表示接口实现诊断性软等变性

Generator-Aligned Representation Interfaces for Diagnostic Soft Equivariance

精选理由

这篇论文让通用神经网络也能处理对称性,不需要专门设计等变算子,在基因、图像和点云数据上都有效果。

AI 摘要

论文提出生成器对齐表示接口GARI,一种表示级设计原则,通过对齐规范视图和生成器诱导视图将选定变换生成器暴露给通用序列骨干。形式化定义了探针特定软等变性残差,并实例化为GARI-Net,该网络通过生成器索引流、共享参数处理、顺序修复和跨流信息交换实现等变诊断。Direct Equivariance Error (DEE)提供冻结检查点诊断。在基因组序列、图像(平面旋转反射)和3D点云(轴向变换)上验证了任务相关的变换一致性。

原文 · arXiv cs.LG

Generator-Aligned Representation Interfaces for Diagnostic Soft Equivariance

Exact-equivariant architectures typically encode prescribed group actions in specialized operators, which can complicate their reuse with generic backbones and across data modalities. We introduce the Generator-Aligned Representation Interface (GARI), a representation-level design principle that exposes selected transformation generators to a generic sequence backbone through aligned canonical and generator-induced views. We formalize the resulting behavior using a probe-specific soft-equivariance residual defined over declared data and transformation distributions. This framework distinguishes representation consistency from task robustness and exact equivariance, and localizes residual mismatch to interface construction, shared stream processing, and terminal fusion. We instantiate the interface as GARI-Net, which constructs generator-indexed streams, converts them into a common interaction frame, processes them with shared parameters, repairs ordering-induced context mismatch, enables cross-stream information exchange, and aggregates them using inter-stream discrepancy. Direct Equivariance Error (DEE) provides a frozen-checkpoint diagnostic of the prescribed representation relation under known token or voxel actions. Experiments on genomic sequences, images, and three-dimensional point clouds examine sequence reversal, planar rotations and reflections, and controlled axial transfer. Across these settings, the same interface principle supports task-relevant transformation consistency and generalization to declared held-out probes without requiring group-specific redesign of the sequence backbone. GARI therefore provides a portable diagnostic complement to hard-equivariant architectures: it makes generator structure accessible, learnable, and measurable, while finite-probe evidence remains distinct from certification of exact equivariance over a continuous group.