CoRE Benchmark Exposes LLM Data-Cleaning Reliance on Known Entities
Benchmark scores on data cleaning may measure memorised entity knowledge rather than repair skill, so leaderboard rankings deserve scepticism when the underlying rows are public. Teams using LLMs to clean operational data should test on renamed surrogates or fresh records before trusting reported accuracy. The released controlled tables and offline replay scoring code make it straightforward to rerun the protocol on in-house data.