想看开源模型能不能真挖漏洞？这个基准用95个真实CVE测了10种模型，最弱的也能找回68%，数据很实在。
论文提出HoF-Bench基准，由AISLE发现的95个真实CVE组成，覆盖8个开源仓库。在严格协议下，一个最小化LLM分析器重新发现了65个CVE（68%）。10个检测骨干包括5个开源模型（21B-284B参数）和5个专有小模型，均无前沿模型参与。基准提供7,600条模型-CVE通过记录，用于比较漏洞扫描器的可靠性。数据集已在Hugging Face发布。
HoF-Bench: Rediscovering Real AI-Discovered CVEs Without Frontier Models
LLM-based analyzers have begun finding real vulnerabilities in mature open-source projects: AISLE's analyzer is credited with more than 280 CVEs across 78 projects, including OpenSSL, curl, and GnuTLS. We introduce HoF-Bench (named after AISLE's public Hall of Fame), a benchmark built from 95 of these public AI-discovered CVEs across eight repositories pinned at vulnerable commits. Analyzers receive source and target-file scope but not CVE identifiers, descriptions, fixes, or expected mechanisms; a detector-blinded frontier-model judge credits only findings that identify the same code path, root cause, attack condition, and impact. A deliberately minimal LLM-based analyzer rediscovers up to 65 of the 95 CVEs (68%) under this strict protocol. No frontier model performs detection anywhere in the study. The ten detector backbones are five open-weight models (21B--284B total parameters, 3--13B active) and five proprietary small or "flash"-tier models. All of them run in the fixed scaffold with four repeated passes, an optional generated-context stage, and a replayable multi-round triage stage (7,600 model--CVE pass records). Difficulty is strongly structured by language; the CVEs missed by every model concentrate in C infrastructure code. HoF-Bench provides a compact test bed for comparing vulnerability scanners, their reliability across repeated runs, and the candidate volume they create. The dataset is available at https://huggingface.co/datasets/aisleinc/HoF-Bench.