Jerry Liu 发布 FlyOCR，用果蝇大脑模型实现 PDF 文本识别
Introducing FlyOCR 🪰 - I trained a fly brain to read a PDF It uses the full MaleCNS v1.0 fruit fly...
Jerry Liu 新发布的 FlyOCR 很有意思，他用果蝇大脑模型来识别 PDF，准确率挺高的，可能比一些传统的 VLMs 更好。
Jerry Liu 发布 FlyOCR，该模型基于完整雄性果蝇大脑（MaleCNS v1.0）架构，将 PDF 图像分割为单个字符，通过模拟 166k 神经元和 25m 边的简化电流动态，在 1.7k+ 字符样本上达到 87% 准确率，能正确识别财务报表中的数字值。
Introducing FlyOCR 🪰 - I trained a fly brain to read a PDF It uses the full MaleCNS v1.0 fruit fly...
Introducing FlyOCR 🪰 - I trained a fly brain to read a PDF It uses the full MaleCNS v1.0 fruit fly connectcome. The architecture is inspired by doomfly by @nftechie_ The fly splits a pdf image into individual glyphs, maps pixels into receptor activations, runs simplified current-based dynamics across the 166k neurons and 25m edges in the circuit, applies a compact readout model on the downstream spikes, and concatenates everything into the parsed output. On reading an actual Microsoft 10-k, the fly gets ~86% over the balance sheet heading, but is largely able to read the numeric values correctly. Over 1.7k+ sampled glyphs (chars+digits) it gets 87% accuracy. With enough training it might match some of the latter-generation MNIST models! Maybe eventually we’ll replace our doc parsing VLMs with flies. Full video below. Repo with full code + report: github.com/jerryjliu/fly_… f Your browser does not support the video tag. 🔗 View on Twitter 💬 3 🔄 0 ❤️ 5 👀 374 📊 4 ⚡
