PapersBuilders11:30Chinese contentDeletion Tuning:只清零不到0.05%的权重即可匹敌全量微调只把模型不到0.05%的权重清零就能达到全量微调效果,还几乎不遗忘旧任务,比LoRA更稳。掩码文件比checkpoint小上千倍,做持续学习和多任务后训练的工程师很该看看这篇。#Deletion Tuning#LoRA#微调#强化学习aarXiv cs.LG@Jack Lu et al. (6)SourceRead laterReadWorth followingUsefulFollow Deletion Tuning