Papers

EEGDash 发布 77 个公开 EEG 数据集训练语料,规模 14,075 小时

EEGDash Corpus: A Training-Ready Public Corpus for EEG Foundation Models

Why we picked it

做 EEG 基础模型的同学可以看看:77 个数据集、1.4 万小时数据统一格式打包好,许可证标清楚,重训结果也贴近原模型。

eegdash-corpus-v0 汇集 77 个公开 EEG 数据集,共 14,075 小时、7,272 名受试者,以 Hugging Face gated 数据集形式发布并附每个文件的 SHA-256。最大公开 EEG 基础模型 REVE 名列 89 个预训练数据集,其中 12 个不可再分发,包括占其 82% 时长的 4 个临床档案。作者用 REVE 的转换方法将数据统一存入分块 Zarr 存储,每个数据集附带许可证信息,可整体或按子集训练。作者用原代码从头重训 REVE-Base 两次,在 OpenEEGBench 七个任务上得到 0.331(线性探测)和 0.273(微调),接近官方发布模型的 0.333 和 0.325。转换器、转换报告和数据加载改动一并开源。

Original · arXiv cs.LG

EEGDash Corpus: A Training-Ready Public Corpus for EEG Foundation Models

Foundation models for electroencephalography (EEG) are pretrained on tens of thousands of hours of recordings, and their accuracy grows with that amount. Such data is hard to assemble. The largest sources are clinical archives that cannot be redistributed, and the public sources are spread over several archives, file formats, and licences. We release eegdash-corpus-v0, a training-ready corpus of 77 public EEG datasets, as the gated Hugging Face dataset EEGDash/eegdash-corpus-v0 with the SHA-256 of every file. REVE, the largest published EEG foundation model, names 89 datasets as its pretraining corpus. Twelve cannot be redistributed: four clinical archives that hold 82% of its hours, and eight under no-derivatives licences. The corpus holds the 76 others that REVE's sampling rate allows and one more from REVE's release card: 77 datasets, 14,075 hours from 7,272 subjects, 5.0 million 10-second samples and 6.21 billion tokens per epoch. Every dataset is fetched through EEGDash, converted once with REVE's recipe, and stored in its own buckets of a chunked Zarr store with its licence recorded beside it, so a model can train on the whole store or on any subset of datasets. To test that the store pretrains a model, we retrain REVE-Base from scratch twice with the authors' code, changed only in how it reads data, and score it on seven public OpenEEGBench tasks. It reaches 0.331 under linear probing and 0.273 after fine-tuning, against 0.333 and 0.325 for the released model and 0.200 and 0.205 for an untrained encoder. The converter, the conversion reports, and the loader changes are released with the corpus.