#安全训练

3 stories · 0 in 7 days · 0 in 30 days
Stories, products and papers tagged "安全训练", newest first.
Sep 18
PapersPolicySelected78°10:18
Harm Laundering in GPT Models: Evidence That Gender Discrimination Is Transformed Rather Than Reduced Across Safety-Trained Generations

This research provides a critical methodological framework for evaluating the true impact of safety training on large language models, showing that toxicity scores alone are insufficient to measure real-world harm.

arXiv: OpenAI@Sarah Wyer et al. (3)Source
Aug 29
Jul 30
PapersMulti-sourceSelected09:31
Chinese contentConstitutional Midtraining:中期插入宪法内容可提升模型对齐

Anthropic提出了在模型训练中期加入宪法性内容来提升对齐持久性,在blackmail任务上降了17.5pp,而且不牺牲MMLU等能力,值得搞对齐的人看看。

Event
arXiv: Anthropic@Desiree Cho et al. (7)9 sourcesSource