LlamaIndex 拆解 LlamaParse 置信度分数如何控制文档抽取自动化

7 的置信度可能对应 95% 精确率，0.9 对应 98% 精确率。

基于 ExtractBench 基准，在 97% 精确率目标下，LlamaParse Agentic Plus 过滤后达到 66.48% 的字段召回率。

文章还讨论了精确率与召回率、分数覆盖度、颗粒度和人工审核量等取舍。

This is a fantastic blog post from our research team on the importance of calibrated confidence scores. Here it's in the context of document extraction, it's also extremely important for more general agentic decision making (eg with Jev) When you set a confidence threshold, you can choose to automatically accept values above that threshold and do HITL review of values below the threshold. The higher the confidence threshold, the higher precision you're able to guarantee (e.g. confidence of 0.7 could mean 95% precision, confidence of 0.9 could mean 98% precision), but of course the more human review you'd have to do on false negatives. We've put in a lot of work to make sure our confidence scores are well calibrated and represents real uncertainty over complex documents in production. Come check out our blog: llamaindex.ai/blog/what-make… LlamaParse: cloud.llamaindex.ai

This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include LlamaParse, LlamaIndex, ExtractBench, RAG.

Source attribution: curated from Jerry Liu (@jerryjliu0). Cross-source corroboration: 2 independent sources have covered this development (including LlamaIndex), confirming industry-wide signal strength.