Industry

欧洲人权法院禁赛两年:罗马尼亚律师引用AI虚构判例被查处

Why we picked it

一个真实翻车案例:罗马尼亚律师用AI写状纸,结果引用的判例根本不存在,被欧洲人权法院停职两年。对比各家厂商宣称幻觉率大幅下降,这案子说明没人工核查照样出事,做法律、合规工作的朋友尤其该看看。

欧洲人权法院(ECtHR)对一名罗马尼亚律师作出停职两年的处罚,起因是她提交的AI代写文书引用了不存在的法院判例。法院还在真实判决书中发现了凭空编造的段落,甚至有真实判例的内容恰好与她引用它所支持的论点相矛盾。

Body

这位律师承认使用了AI,但辩称这些问题只是“引用错误”。法院调查后认定,部分引用“完全没有经过任何核查”。Gary Marcus 转发此案并评论称,所谓“幻觉已基本解决”的说法本身就是一种幻觉——说明语言模型的虚构引用问题在实际法律工作中并未消失,从业者不加核查直接使用会带来真实的职业后果。

Original · Gary Marcus

“Hallucinations are basically solved!” is itself a hallucination. International Cyber Digest @IntCyberDigest ‼️ Europe's top human-rights court has banned a Romanian lawyer for 2 years after her AI-drafted filings cited court cases that don't exist. The European Court of Human Rights also found made-up paragraphs in real rulings, and real rulings that contradicted the very arguments she cited them for. She admitted using AI and called the mistakes "citation errors." The court found that for some references, "no checks whatsoever had been carried out." 🔗 View Quoted Tweet📊 4 ⚡

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Industry" desk, focusing on Europe's AI governance and technology ecosystem. Within our cross-regional analytical framework, it directly maps to AI regulation, compliance frameworks, and sovereign compute policy. Key entities and technical topics under continuous tracking include ECtHR, GaryMarcus, hallucinations, AI safety.

Source attribution: curated from Gary Marcus (@GaryMarcus).