这篇论文发现OpenAI的GPT-2检测器对自闭症写作者有统计上显著的偏见——误判率虽低但差异存在。如果你关心AI公平性，值得看看。
一项新研究分析了约60,000条Reddit帖子，分为“可能自闭症”和“普通Reddit”两个子语料库，使用OpenAI GPT-2检测模型计算文本被判定为AI生成的概率。结果显示，虽然两个子语料库中被标记为AI生成的比例均低于2%，但“可能自闭症”子语料库中被标记的文本比例显著更高。研究进一步比较了文本特征，发现自闭症写作与AI生成文本的特征关联并不简单。作者呼吁对AI检测模型在学术和日常使用中的潜在偏见进行伦理审查和更深入的批判性研究。
The Misclassification of Autistic Writing as AI-Generated
Recent findings suggest that detection models for artificial intelligence (AI) cannot accurately identify AI-generated text and may exhibit bias against certain minority groups. In the present study, anecdotal claims that autistic writers more often have their work flagged as AI-generated are examined empirically. A corpus of approximately 60,000 Reddit posts split into "likely-autistic" and "general-Reddit" subcorpora is used to compare the distribution of probabilities output by the OpenAI GPT-2 detection model. Differences in textual features between subcorpora are observed and compared to reported features of AI-generated text. Results showed that while less than two-percent of either subcorpus was flagged as AI-generated by the model, significantly more texts from the likely-autistic subcorpus were flagged. Connections between features of text with likely-autistic authors and AI-generated text were not straightforward. The widespread use of AI-detection models with a potential bias against autistic writers in their output prompts ethical scrutiny, and the authors recommend further critical examination of the models themselves as well as their use in academic contexts.