这篇论文提出CIRCLE方法:用固定储层特征做持续学习,无需回放,在长任务序列上比现有方法更快更准确。
CIRCLE是一种基于固定双向二维储层特征(BiRC2D)的类增量分类器,使用流式线性判别分析(SLDA)头。它不需要回放、外部预训练或大初始任务。在CIFAR-100、TinyImageNet、ImageNet-Subset和ImageNet-1k数据集上,CIRCLE在10-20任务分割中表现有竞争力,在50、100和500任务分割中大幅超越现有强基线。同时训练速度远快于有回放的方法。消融实验表明,BiRC2D特征提取器、SLDA头和平衡特征/预测集成各自贡献了性能。
Data-Free Reservoir Features for Efficient Long-Horizon Cold-Start Continual Learning
Cold-start exemplar-free class-incremental learning requires learning a growing set of classes without replay, external pretraining, or a large initial task. Existing cold-start methods typically either train the backbone throughout the stream and compensate for semantic drift, or freeze a backbone after the first task, producing features biased toward the initial classes. These choices also create a computational tension: drift-compensation methods require repeated backbone training and increasingly expensive updates as the task horizon grows, while frozen-backbone methods are cheap but weak under cold start. We study a third option: a feature extractor that is never fit to image data at all. We propose CIRCLE, a class-incremental classifier built from fixed bidirectional two-dimensional reservoir features, adapted from BiRC2D for image classification, and streaming linear discriminant analysis heads. CIRCLE groups multiple random reservoir instantiations into feature ensembles and averages the softmax outputs of independent SLDA heads, yielding a tunable bias-variance tradeoff between richer random features and prediction-level ensembling. Because the feature extractor is fixed and the head admits streaming closed-form updates, CIRCLE performs sample-wise training without replay, task-boundary information, or backbone backpropagation. On CIFAR-100, TinyImageNet, ImageNet-Subset, and ImageNet-1k, CIRCLE is competitive at 10-20 task splits and substantially outperforms strong CS-EFCIL baselines at 50, 100, and 500 task splits, while training much faster than trained-backbone drift-compensation methods. Ablations show that the BiRC2D-style extractor, SLDA head, and balanced feature/prediction ensembling each contribute to the final performance.