OT-CAL:用最优传输做自适应样本选择,训练提速1.18倍以上
OT-CAL: Optimal-Transport-Guided Adaptive Sample Selection for Efficient Visual Learning
一篇训练提效的论文:训练时只挑一半样本做反向传播,还比全量数据快1.2倍,比AdaSelection高1-2个点,做CV训练的可以看看
训练图像识别模型时,反向传播只对有价值的样本进行,可显著降低计算量。OT-CAL 用难度、可学习性、不确定性等五个信息量特征表示每个样本,通过最优传输匹配与课程向量动态调整选样权重,无需人工设定调度规则。在三个视觉基准上,每个 mini-batch 只选 50% 样本时,OT-CAL 比 AdaSelection 高出 1.3-2.1 个点,训练速度比全量数据快 1.18-1.24 倍。
OT-CAL: Optimal-Transport-Guided Adaptive Sample Selection for Efficient Visual Learning
Deep neural networks for image recognition are typically trained using mini-batches, with a forward pass to compute predictions and losses followed by a more computationally expensive backward pass to update model parameters. However, not all training samples contribute equally to learning, suggesting that computation can be reduced by performing backward passes only on informative samples. The challenge is that sample informativeness changes throughout training: difficult samples may be valuable early on, improving samples become important later, and class diversity becomes increasingly relevant toward the end. Existing methods often rely on fixed selection rules or computationally expensive per-sample gradient calculations. We propose OT-CAL, an adaptive data selection method that automatically adjusts its sampling preferences during training. OT-CAL represents each sample using five informativeness features, including difficulty, learnability, and uncertainty. A curriculum vector describes the currently preferred sample characteristics, and optimal-transport-based matching assigns selection weights according to how closely samples match this target. The curriculum vector is then updated using the selected samples, forming a feedback loop that adapts without a manually defined schedule. Experiments on three standard visual learning benchmarks show that, when selecting 50% of each mini-batch, OT-CAL improves performance by 1.3--2.1 points over AdaSelection while achieving 1.18--1.24 times faster training than full-data training.