论文提出新框架解决领域演化下的迁移学习问题
Transfer Learning for Evolving Domains
这篇论文提出了一个解决领域演化下迁移学习问题的全新框架TrED,对相关研究者很有参考价值。
这篇论文提出了一种名为TrED的新框架,用于处理数据在训练过程中不断演化的迁移学习问题。该框架将整个学习轨迹视为一个整体,而不是孤立的任务。作者认为现有方法大多针对单一阶段,未能优化整个轨迹。
Transfer Learning for Evolving Domains
Transfer learning explores how to leverage knowledge from various tasks or domains (sources) to enhance predictive performance in related tasks or domains (targets). Typically, transfer learning research is segmented into several isolated sub-areas (such as domain generalisation, domain adaptation, or multi-domain learning), each making distinct assumptions about target data availability, namely how much data and how many labels are available at training time. However, in many real-world applications, data availability is not fixed but evolves over time, as instances and labels are progressively collected from a new domain. Each of the classical settings then describes only a snapshot of a trajectory that a deployed system must traverse in full. We formalise this trajectory as a transfer learning problem in its own right, Transfer Learning for Evolving Domains (TrED), specified by a data availability process fixed by the environment, a learning protocol that the method is free to choose, and an evaluation criterion that scores the whole trajectory of models rather than a single one. Within this formalism, the classical settings are recovered as regimes that a learner may pass through, rather than as separate problems that TrED concatenates. We then examine the transfer learning literature to identify mechanisms that are promising building blocks for a solution, and find that most methods are tailored to a single regime and that even the strongest existing candidates do not yet optimise the whole trajectory. We argue that TrED is a well-posed and unsolved problem, and an important direction for future research.