做长上下文AI应用或RAG系统的团队，这个发现会颠覆你对上下文管理的认知——不是堆更多文档就能提升效果，少而精才是关键，建议点开看看具体实验数据。
研究发现，长上下文AI模型并非被大量错误信息逐渐削弱，而是仅需10%的误导性段落就能造成近58%的性能损失，这种现象被称为“第一滴墨水效应”。误导信息之所以危险，是因为它们与问题高度相关但错误，在注意力机制中会挤占正确答案的空间。在128K token的Qwen2.5实验中，前10%的硬干扰项解释了97%的干扰压力。这意味着过滤文档时，移除坏内容不如缩短整个上下文有效。该研究对构建长上下文AI系统的开发者具有重要警示意义。
A long-context AI can be poisoned by a few plausib…
A long-context AI can be poisoned by a few plausible wrong passages, not gradually worn down by many.
At just 10% bad context, the damage is already almost done.
“THE FIRST DROP OF INK ” effect, analogous to how a single drop of ink contaminates water.
The mistake is to picture context as storage.
In a long prompt, the model is not calmly filing facts into separate boxes; it is running a competition over which pieces of text deserve attention when the answer is generated.
Hard distractors are dangerous because they are not random junk.
They are close enough to the question to look useful, but wrong enough to pull the model away from the gold evidence.
In the authors’ setup, if performance loss were proportional, the first 10% of hard distractors would explain about 10% of the total damage, but in one 128K-token Qwen2.5 setting it explained 58%.
The mechanism is simple once you see it: softmax attention rewards relative closeness, so a misleading passage that sits near the answer in logit space can crowd the denominator far more than irrelevant filler.
At only 10% hard distractors, they can already account for about 97% of the distractor pressure.
This also changes how we should read filtering results.
If removing documents helps, the benefit may come less from removing “bad” content than from shortening the whole battlefield.
For long-context systems, the safest misleading passage is the one that never enters the prompt.
---
Link – arxiv .org/abs/2605.10828
Title: "The First Drop of Ink: Nonlinear Impact of Misleading Information in Long-Context Reasoning"