这篇论文点破了 LLM 幻觉的核心矛盾——不是知识不够，而是不知道什么时候该说“不确定”。做 AI 产品、智能体或对话系统的团队，看完会对“诚实比正确更重要”有更深理解，建议直接读原文。
Google 新论文指出，大语言模型的幻觉问题根源不在于回答错误，而在于错误时仍显得过于自信。论文提出应将目标从追求完美事实性转向让模型诚实表达自身不确定性，即“忠实的不确定性”。作者认为，模型缺乏的不是知识，而是对自身认知的元认知能力。对于智能体而言，不确定性感知能决定何时搜索、何时信任来源、何时停止，比工具本身更重要。
New Google paper says LLMs should stop pretending …
New Google paper says LLMs should stop pretending certainty and instead clearly show when they are unsure.
Hallucination is less about machines being wrong than about machines sounding certain when they should hesitate.
That distinction changes the target-problem.
The paper changes the target from making models perfectly factual to making them honest about their own uncertainty.
For years, the obvious goal has been to make language models know more, so they make fewer factual mistakes.
Perfect factuality may be very hard, but a model that clearly separates “I know this” from “I am guessing” can stay useful without quietly damaging trust.
This paper argues that the harder missing skill is not knowledge, but self-knowledge.
A model can be well calibrated in the broad sense, knowing that answers like this are correct about 60% of the time, yet still fail to identify which particular answer is the dangerous one.
That is the trap: to eliminate errors, the system must refuse many answers that would have been right.
The authors call this the utility tax, and it explains why products keep drifting toward confident usefulness rather than cautious truth.
Here's the key point.
A wrong answer wrapped in honest uncertainty is not the same social object as a wrong answer delivered as fact.
It gives the user a different instruction: verify this, treat it as provisional, do not build too much on it.
The proposed fix is “faithful uncertainty,” where the model’s language mirrors its internal confidence instead of smoothing doubt into authority.
For agents, this becomes even more important, because uncertainty is what should decide when to search, when to trust a source, and when to stop.
Tools expand what a model can access, but metacognition governs whether access is used wisely.
----
Paper Link – arxiv. org/abs/2605.01428v1
Paper Title: "Hallucinations Undermine Trust; Metacognition is a Way Forward"