LlamaIndex 推出 liteparse-grpc,文档处理新增 gRPC 接口

Document processing pipelines are often made up of multiple services: parsing → chunking → embedding...

精选理由

LlamaIndex 给 LiteParse 加了 gRPC 接口,微服务之间调文档处理更快了,还能解析 PDF、Office 和图片,带截图和 OCR 预判,适合多语言系统。

AI 摘要

LlamaIndex 为文档处理工具 LiteParse 新增 gRPC 接口(liteparse-grpc),支持以 npm 包或 Docker 镜像运行。该接口可解析 PDF、Office 文档和图片为 JSON、text 或 Markdown,还能将 PDF 页面渲染为截图,并估算文档复杂度及是否需要 OCR。此前 LiteParse 仅可通过 REST 调用,新接口更适合服务间通信。liteparse-grpc 还包含 CLI 客户端、TypeScript 客户端存根和 protobuf 定义,方便生成 Python、Go、Java 等语言的客户端。

原文 · LlamaIndex

Document processing pipelines are often made up of multiple services: parsing → chunking → embedding...

Document processing pipelines are often made up of multiple services: parsing → chunking → embeddings → storage. Until now, LiteParse was only available over REST. That works well for browsers and simple integrations, but it’s not always the best fit for service-to-service communication. Today we’re introducing liteparse-grpc. With @𝘭𝘭𝘢𝘮𝘢𝘪𝘯𝘥𝘦𝘹/𝘭𝘪𝘵𝘦𝘱𝘢𝘳𝘴𝘦-𝘨𝘳𝘱𝘤 (npm) or the 𝘨𝘩𝘤𝘳.𝘪𝘰/𝘳𝘶𝘯-𝘭𝘭𝘢𝘮𝘢/𝘭𝘪𝘵𝘦𝘱𝘢𝘳𝘴𝘦-𝘨𝘳𝘱𝘤 Docker image, you can run LiteParse as a gRPC service and: 📄 Parse PDFs, Office documents, and images into JSON, text, or Markdown 📸 Render PDF pages as screenshots 📊 Estimate document complexity and whether OCR is needed The package also includes a CLI client for testing, generated TypeScript client stubs and the protobuf definitions, so you can generate clients for Python, Go, Java, or any other language supported by 𝘱𝘳𝘰𝘵𝘰𝘤 The REST server isn’t going anywhere, this is simply another interface for teams building polyglot, microser llamaindex.ai/blog/introduci… elines. 📖 github.com/run-llama/lite… n: https://t.co/iAIBoXzhEH 💻 GitHub: https://t.co/K0d8XVE7Rc 💬 0 🔄 0 ❤️ 1 👀 271 ⚡