Google Research Releases SLEEP Framework for Offline Memory Consolidation in LLMs
SLEEP treats forgetting as an architecture-scheduling problem rather than a fine-tuning tuning problem, borrowing sleep-cycle logic from neuroscience but implemented as standard post-training. Engineers running continuously updated assistants can evaluate whether MoE memory expansion plus GKD distillation beats replay-based continual learning on their own benchmarks. Details and implementation notes are on the Google Research blog.
