CLEAR框架提出了一种新的LLM安全对齐方法,在保持模型效用的情况下显著提高了鲁棒性,对于关注LLM安全性和效用平衡的研究者来说是个重要进展。
提出CLEAR,一种条件安全适配框架,通过轻量级隐藏状态门控制安全低秩适配器的激活强度,旨在减少有害输出同时避免对良性提示的性能影响。实验表明,CLEAR在HarmBench上提高了鲁棒性,同时减少了SFT或LoRA等全局安全调整带来的效用损失。在Llama-3-8B-Instruct上,CLEAR将HarmBench ASR从32.3%降至0.5%,并保持了大部分基模型的效用,比全局SFT或LoRA提高了7.1个百分点的GSM8K准确率。
CLEAR: Continuous Latent Adapter Routing for Utility-Preserving LLM Safety Alignment
Improving the safety of large language models (LLMs) often comes at the expense of utility, as globally applied safety tuning may affect model responses to both harmful and benign inputs. We propose \textbf{C}ontinuous \textbf{L}at\textbf{E}nt \textbf{A}dapter \textbf{R}outing (CLEAR), a conditional safety adaptation framework that uses a lightweight hidden-state gate to continuously control the activation strength of a safety low-rank adapter. CLEAR aims to reduce harmful completions while avoiding unnecessary changes to the frozen backbone that could degrade performance on benign prompts. Experiments on widely used safety and utility benchmarks show that CLEAR improves robustness on HarmBench while reducing the utility degradation observed with globally applied safety tuning such as SFT or standard low-rank adaptation (LoRA). On Llama-3-8B-Instruct, CLEAR reduces HarmBench ASR from 32.3\% to 0.5\%, while retaining most of the base model's utility and achieving up to 7.1 percentage points higher GSM8K accuracy than globally applied SFT or LoRA. These results suggest that CLEAR is a promising mechanism for improving the safety--utility trade-off in LLM alignment.
- elvis08-20 15:50原文