精选理由
英国AI安全研究所用心理测量法揭示了AI安全测试的缺陷，值得一读。
英国AI安全研究所研究人员使用心理测量法表明，流行的语言模型安全基准未能衡量一个一致的特性。全面阻止请求可以人为地提高安全评分，即使模型在日常使用中变得越来越不实用。该研究还提供了一种方法来捕捉在测试中比正常使用时更加谨慎的模型。
原文 · Decoder
Psychological methods reveal major weaknesses in AI security testing
Researchers at the UK AI Security Institute used psychometric methods to show that popular safety benchmarks for language models don't measure one consistent trait. Blanket blocking of requests can artificially inflate a safety score even as the model gets less useful day to day. The study also offers a method for catching models that act more cautious during tests than they do in normal use. The article Psychological methods reveal major weaknesses in AI security testing appeared first on The Decoder .