TARGRS：测试时表征采样方法为大模型去毒化降毒性最高69.38%
LLM Detoxification via Transition-Aware Reward-Guided Representation Sampling
一篇去毒化新论文，方法 TARGRS 在 RealToxicityPrompts 上降毒性近 70%，还不怎么拖慢推理速度，连视觉语言模型也适用。
论文提出 Transition-Aware Reward-Guided Representation Sampling（TARGRS），一种测试时去毒化框架。它在潜空间构建从无毒到有毒状态的轨迹，用毒性评分生成密集监督训练 transition-aware token 级奖励模型。在 RealToxicityPrompts、BOLD、AttaQ 三个基准上测试 10 个 LLM，TARGRS 在 RealToxicityPrompts 上将毒性最高降低 69.38%，推理速度接近原始模型。该方法还可扩展到视觉语言模型，在 3 个代表性 LVLM 上毒性最高降低 64.23%。
LLM Detoxification via Transition-Aware Reward-Guided Representation Sampling
Large Language Models (LLMs) can generate toxic content, motivating effective test-time detoxification. Existing representation steering methods often rely on static or coarse interventions and provide imprecise guidance because they inadequately model transitions between toxic and non-toxic generations. We propose Transition-Aware Reward-Guided Representation Sampling (TARGRS), a test-time framework that learns reward guidance over toxicity transitions in latent representation space. During exploration, progressive steering along the toxicity direction constructs trajectories from non-toxic to toxic states. Toxicity scores along these trajectories turn sparse annotations into dense, listwise supervision for a transition-aware token-level reward model. During inference, TARGRS uses this model to guide coarse-to-fine sampling along the opposite, non-toxic direction: coarse sampling identifies the intervention needed to reach non-toxic regions, and refinement selects a detoxified representation with minimal perturbation. Experiments on 10 LLMs across RealToxicityPrompts, BOLD, and AttaQ show that TARGRS consistently outperforms state-of-the-art baselines, reducing toxicity by up to 69.38% on RealToxicityPrompts. TARGRS runs nearly as fast as the original LLM while preserving its core capabilities with minimal impact. By intervening in the language decoder space, TARGRS also extends to Large Vision-Language Models (LVLMs), reducing toxicity by up to 64.23% across 3 representative LVLMs.