做生物信息学软件质量保障的团队终于有了专用数据集——BioDefect 比通用数据集 F1 提升近 40%，做缺陷检测研究的可以直接用它来训练和评估模型。
现有软件缺陷检测研究缺乏针对生物信息学软件的专用数据集，导致模型在该领域表现受限。研究者推出了BioDefect，这是首个专为生物信息学软件缺陷检测设计的数据集，包含完整源代码仓库，保留了缺陷代码的真实上下文信息。该数据集解决了标签不一致和数据泄露问题，确保高质量和实验可靠性。在包括DeepSeek-R1在内的9个语言模型上的评估显示，BioDefect相比现有数据集平均F1分数提升29.61%至38.04%。这项工作填补了生物信息学软件缺陷检测的研究空白，为提升该领域软件质量保障提供了新方向。
BioDefect: The First Dataset for Defect Detection in Bioinformatics Software
Software defect detection is a critical task in software engineering. However, no prior studies have specifically addressed defect detection in bioinformatics software. Given that the performance of defect detection tasks is primarily influenced by both models and datasets, our experiments controlled for model-related factors and confirmed the limitations of existing datasets in bioinformatics software. To address this issue, we introduce BioDefect, the first dataset specifically designed for defect detection in bioinformatics software, aiming to overcome the limitations of existing datasets in this context. Unlike prior datasets, BioDefect includes complete source code repositories, preserving the actual contextual information of defective code, thereby more accurately reflecting real-world defect scenarios in bioinformatics software. Additionally, BioDefect mitigates issues related to label inconsistency and data leakage, ensuring high data quality and experimental reliability. To evaluate the effectiveness of BioDefect, we conduct a systematic assessment on nine language models (LMs), including DeepSeek-R1. The results demonstrate that BioDefect significantly enhances defect detection performance for bioinformatics software. Compared to existing datasets, BioDefect achieves an average F1-score improvement of 29.61% to 38.04% across all models, highlighting its superior advantages. This study fills a critical research gap in bioinformatics software defect detection, laying a foundation for future studies in this field and offering new insights for improving bioinformatics software quality assurance.