技巧

开源库DocJev发布,文档分类与分割速度比GPT-5.6-Luna快6倍

Introducing DocJev - a lightning-fast OSS library for document classification and splitting with jev...

精选理由

朋友开发的开源库,能快速分类和分割文档,比GPT-5.6-Luna快6倍,适合处理数字文档。

介绍DocJev,一个用于文档分类和分割的快速开源库。它使用自然语言分类规则预测文档类别或子文档边界。与GPT-5.6-Luna相比,其速度提升了6倍,同时保持等效准确率。支持选择不同的OCR后端,如liteparse和LlamaParse。

图片来源 · Jerry Liu
原文 · Jerry Liu

Introducing DocJev - a lightning-fast OSS library for document classification and splitting with jev...

Introducing DocJev - a lightning-fast OSS library for document classification and splitting with jev ⚡️ Give a document alongside some natural language category rules. Jev will predict the document category (classify) or the boundaries between sub-documents (split). It is 6x faster than gpt-5.6-luna with equivalent accuracy. You can choose between different OCR backends: liteparse: the fastest/most accurate free+OSS text parser out there. Perfect for digitalized documents. The speedups vs. luna above are inclusive of liteparse times. LlamaParse: the most advanced VLM-based solution for complex docs. Using this will of course add latency on document preprocessing. But it’s a good option if you want to cache the digitalized representations of documents for a variety of downstream tasks. Check it out: github.com/jerryjliu/docj… If you want to dive deeper into liteparse or LlamaParse check the links below: liteparse: github.com/run-llama/lite… LlamaParse: cloud.llamaindex.ai Your browser does not support the video tag. 🔗 View on Twitter 💬 2 🔄 0 ❤️ 3 👀 505 📊 4 ⚡