The result shows cheap small-model passes can beat LLM rerankers when split into selection and ranking stages, cutting model-call latency without losing recall on multi-hop questions. Teams building Graph RAG on Milvus can copy the two-stage pattern directly from the Zilliz repo. Compared with LLM-based reranking, the trade-off is a measurable recall gain for under a second of extra call time.
The interesting shift is that retrieval becomes a tree-traversal decision problem instead of an embedding-similarity problem, so latency scales with tree depth rather than corpus size, with billion-paragraph corpora theoretically needing around five decisions. Teams paying for a reranker stage, or struggling with weak first-stage recall on help centres and document corpora, can test the tree-plus-decision-model setup; on NQ a dense retrieval stage can optionally be mixed in to recover over-pruned evidence. It competes with Qwen3-Reranker-8B pipelines at lower cost.
Headline accuracy is the wrong metric when choosing a RAG claim checker, because a verifier can look accurate while waving through a large share of unsupported claims. Teams building retrieval-backed products should benchmark false-approval rates alongside cost before wiring in a cheap verifier, and cascade designs may not save more than random routing. The finding applies to any RAG stack where a wrong approval is costlier than a wrong rejection.