Papers

NoCherry 协议:用去中心化随机信标验证私有数据抽样

Verifiable Random Sampling of Private Data Without a Trusted Single Party

Why we picked it

做数据集评测或安全审计的团队该看看这篇。它能防止评测方偷偷换掉 held-out 测试集,比单纯口头承诺可信得多,因为随机信标加服务器签名让抽样过程可验证。

arXiv 论文 2611.21222 提出 NoCherry 协议,解决私有数据抽样的可信问题:当数据持有方公开部分样本证明数据质量时,审计方无法判断样本是随机抽取还是刻意挑选。NoCherry 要求数据方先对数据集中每条数据的哈希做承诺,并在独立服务器上登记该承诺。

Body

抽样等待去中心化随机信标——一个每几秒联合发出一次随机值的网络,数据方和审计方都无法控制。承诺登记后两轮信标发出的随机值决定抽哪条数据,每台服务器返回签名回执,任何人事后都能核对公开样本是否与该随机值一致。只要信标的阈值成立且至少一台必需服务器诚实,抽样即保持无偏;预登记的抽样名称还可阻止重复或中途放弃的抽取。

该协议适用于私有 AI 基准与 held-out 测试集、数据集质量声明、代码与安全审计、测试公平性审查、漏洞处理和合规抽检等场景。审计方无需信任数据方交出代表性样本,因为协议本身能证明这一点;数据方也无需暴露整个数据集。

Original · arXiv cs.AI

Verifiable Random Sampling of Private Data Without a Trusted Single Party

Problem: When a party supports claims about a private dataset by disclosing a sample, auditors cannot tell whether it was drawn at random or "cherry-picked" to hide flaws in the rest of the data. Solution: The data holder commits to the hashes of every item in its dataset and registers the commitment with independent servers. Selection then waits on a decentralized randomness beacon: a network that jointly emits a fresh random value every few seconds, outside the control of the data holder and the auditors. The value emitted two beacon rounds after the commitment picks the sample. Each server returns a signed receipt, so anyone can later check that the revealed sample is exactly the one that value prescribes. Selection from the committed set stays unbiased as long as the beacon's threshold holds and one required server is honest, and a pre-agreed name, checked with the servers, stops repeated or abandoned draws. We call this protocol NoCherry. Applications: Any audit that spot-checks a private corpus: private AI benchmarks and held-out test sets, dataset quality claims, code and security audits, test-fairness review, vulnerability handling, and compliance sampling. Auditors need not trust the data holder to hand over a representative sample of the committed data, since the protocol proves it, and data holders need not expose their entire dataset.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Papers" desk. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include NoCherry, benchmarks, data auditing.

Source attribution: curated from arXiv cs.AI (@Muhammed Karamuk, Mikołaj Glinka, Ruben Wolff).