Jerry Liu 谈文档 OCR 两条路线：轻量开源与 VLM 高精度
LlamaIndex 创始人把文档 OCR 拆成两条路线讲：走量用 liteparse，走准用 OCRia-1，做 RAG 文档处理前可以先看看他这个分类思路。
LlamaIndex 创始人 Jerry Liu 提出文档 OCR 分两类：一类是极速廉价的第一遍数字化，组织可处理数万亿文档供智能体检索，代表是 pypdf、pymupdf 等开源工具，其团队自研的 liteparse 已集成 5 个开源 OCR 工具，最新接入 OpenBMB 的 MiniCPM-OCR；另一类是 VLM 驱动的高精度解析，面向金融、保险、医疗等关键业务中复杂布局、表格和图表文档。两周前他们发布了通用文档解析模型 OCRia-1，支撑 LlamaParse 的全部模式，并在 ParseBench 上公开基准成绩。两条路线都以准确率与成本的帕累托前沿为目标。
The world needs two types of document OCR: 1. Extremely fast/cheap OCR tools: Each organization might have trillions of documents, and this is oftentimes helpful as a 'first pass' to digitalize each document so that it's accessible to AI agents. Accuracy might not be the highest, but it's 'good enough' for agentic retrieval and a deeper second pass. This includes free/OSS tools like pypdf, pymupdf. Over the past year, we've invested heavy efforts in this area through `liteparse` - the fastest/most accurate free/OSS parser. It integrates with 5 other open-weight OCR tools, most recently with MiniCPM-OCR from @OpenBMB github.com/run-llama/lite… We're also doing a lot more in this space - stay tuned! 2. Accurate VLM-based OCR: This includes the subset of documents that are a) complex, and b) the organization must parse accurately. The data needs to be accurate because this data is used in business critical workflows across finance, insurance, healthcare, and more. At the same time, even if the tool is not free, any VLM needs to be able to scale to billions of pages in a cost-effective manner. Two weeks ago we launched OCRia-1, the best general purpose model for document parsing. It not only parsers complex text layouts, complex tables, but also visual diagrams and charts. llamaindex.ai/blog/parse-ocr… It powers all our modes within LlamaParse; see the most recent benchmarks on ParseBench: parsebench.ai ------- Both of these document OCR types require rigorous benchmarks, data+training pipelines, and an ambitious/talent-dense team pushing the pareto frontier of accuracy and cost. If you're looking to solve document understanding across either frontier, come talk to us! 💬 5 🔄 0 ❤️ 3 👀 487 📊 6 ⚡
