#VectorDatabase

1 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "VectorDatabase", newest first.
Nov 19
ProductsBuildersSelected23:54
Milvus 3.0 adds MinHash-based near-duplicate detection

Deduplication moving into the database itself removes an entire external pipeline, cutting infrastructure for teams building RAG corpora or scraping pipelines. Engineers preparing LLM training data or cleaning crawled content can now query and insert against the same index without embedding costs. As an open-source vector database, Milvus competes with standalone dedup libraries such as datasketch, and teams in ASEAN and China running multilingual content pipelines can adopt it without vendor lock-in.

Milvus@milvusioSource