生成式AI在伊斯兰研究中的可靠性评估:幻觉与来源保真度

AI and Authenticity in Islamic Research: A Critical Evaluation of Generative AI Reliability, Hallucination, and Source Fidelity in Quranic, Hadith, and Fiqh Knowledge

精选理由

想拿AI问伊斯兰教法?这篇论文用50个问题实测6款AI,看它们怎么编引用、怎么处理学派分歧。

AI 摘要

一项发表在arXiv上的研究评估了6款生成式AI在50个伊斯兰知识开放问题上的表现,涵盖古兰经注释、圣训、教法等4大领域。研究招募澳大利亚和英国参与者,在真实条件下收集回复,分析领域准确率、引用验证、幻觉、教法一致性等维度。结果显示,AI系统在引用验证和来源溯源上表现不佳,存在幻觉和不完整引用,且对教法学派分歧处理不一致。作者认为,AI可作为入门学习工具,但不能作为宗教裁决或学术研究的权威来源。

原文 · arXiv cs.AI

AI and Authenticity in Islamic Research: A Critical Evaluation of Generative AI Reliability, Hallucination, and Source Fidelity in Quranic, Hadith, and Fiqh Knowledge

Generative Artificial Intelligence (AI) is increasingly used by Muslims for religious guidance, Qur'anic interpretation, Hadith explanation, jurisprudential rulings, and Islamic education. Despite its growing adoption, there is limited empirical evidence on whether current AI systems provide authentic, verifiable, and trustworthy Islamic knowledge suitable for high-trust religious contexts. This study evaluates six leading generative AI systems using fifty realistic open-ended Islamic questions covering Qur'anic interpretation, Hadith, Fiqh, ethics, pastoral advice, and Madhhab-sensitive topics. Responses were collected under real-world conditions from participants in Australia and the United Kingdom and analysed using a mixed-method framework examining domain accuracy, citation verification, hallucinations, jurisprudential consistency, uncertainty handling, source provenance, and geographical variation. The study addresses four research questions: (1) How accurate and authentic are AI-generated responses across major Islamic knowledge domains? (2) To what extent do AI systems produce hallucinations, incomplete citations, or unverifiable religious references? (3) How consistently do models handle jurisprudential disagreement, Madhhab diversity, and uncertainty? (4) Are current AI systems sufficiently reliable for religious guidance, Islamic education, and scholarly research? Overall, current generative AI systems are valuable as assistive tools for introductory Islamic learning but should not be treated as authoritative sources for religious rulings or Islamic research without verification against authenticated primary sources and qualified scholarly expertise. This study provides one of the first comprehensive empirical evaluations of AI reliability within Islamic knowledge, offering practical guidance for researchers, educators, AI developers, and the wider Muslim community.

生成式AI在伊斯兰研究中的可靠性评估:幻觉与来源保真度 · AI 热点