开源库 DocJev 发布:按语义边界切分文档,速度达 gpt-5.6-luna 的 6 倍
you can find a nice interactive visualization of docjev splitting in action here. it matches luna i...
做文档切分可以试试 Jerry Liu 新开源的 DocJev,比 luna 快 6 倍、准确率相当,还带可视化页面。
LlamaIndex 创始人 Jerry Liu 发布开源库 DocJev,用于文档分类与子文档边界切分。用户只需提供文档加一段自然语言类别规则,jev 即可预测文档类别或切分位置,官方称速度比 gpt-5.6-luna 快 6 倍且准确率相当。DocJev 支持两种 OCR 后端:liteparse 号称最快最准的免费开源文本解析器,LlamaParse 则是基于 VLM 的复杂文档方案。项目附带交互式可视化页面,可直观查看切分效果。
you can find a nice interactive visualization of docjev splitting in action here. it matches luna i...
you can find a nice interactive visualization of docjev splitting in action here. it matches luna in being able to split complex document text along the right semantic boundaries jerryjliu.github.io/docjev/ Jerry Liu @jerryjliu0 Introducing DocJev - a lightning-fast OSS library for document classification and splitting with jev ⚡️ Give a document alongside some natural language category rules. Jev will predict the document category (classify) or the boundaries between sub-documents (split). It is 6x faster than gpt-5.6-luna with equivalent accuracy. You can choose between different OCR backends: liteparse: the fastest/most accurate free+OSS text parser out there. Perfect for digitalized documents. The speedups vs. luna above are inclusive of liteparse times. LlamaParse: the most advanced VLM-based solution for complex docs. Using this will of course add latency on document preprocessing. But it’s a good option if you want to cache the digitalized representations of documents for a variety of downstream tasks. Check it out: github.com/jerryjliu/docj… If you want to dive deeper into liteparse or LlamaParse check the links below: liteparse: github.com/run-llama/lite… LlamaParse: cloud.llamaindex.ai Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 4 🔄 2 ❤️ 23 👀 2399 📊 9 ⚡
- shao__meng09-20 23:54原文