生物信息学研究者终于有了一个能跑全基因组的超快模型——Carbon 把处理时间从数周压缩到两天内，做基因组分析或蛋白质设计的团队可以直接用 demo 试效果。
Hugging Face 团队发布了名为 Carbon 的 DNA 模型，其速度比当前最先进的 Evo2 快 275 倍，可在单 GPU 上两天内处理整个人类基因组。Carbon 的核心创新在于其独特的 tokenizer：将 DNA 序列切分为 6 碱基的块，同时保留单碱基分辨率，解决了 BPE 分词器在无空格序列上的低效问题。该模型支持 DNA 序列生成、基因结构分析、突变效应预测、蛋白质折叠以及生命树重建等任务。团队还提供了交互式 demo 供用户探索。
It turns out DNA modeling is interestingly different from language modeling. Read more in our intera...
It turns out DNA modeling is interestingly different from language modeling. Read more in our interactive blogpost/demo and explore our work here A joint work of the @huggingscience , pre-training and post-training teams here Leandro von Werra @lvwerra We are releasing Carbon: a crazy fast DNA model Carbon is 275x faster than the next best model. So fast you can process the whole human genome on a single GPU in <2 days. Here are the tricks we used: When modelling DNA sequences a lot of the performance comes down to tokenizing the sequences in a smart way. BPE tokenizer struggle because there are no whitespaces and character (called base in DNA) level tokenizers waste a lot of compute on too many tokens. Carbon is built with a unique tokenizer: we split sequences in chunks of 6 bases, but during both training and inference we can work with single base resolution. That's similar to having word tokens but resolving them at the character level. All possible thanks to the DNA tokens unique structure. The architecture combined with the tokenizer makes the model 275x faster than the previous SoTA (Evo2) at this size. We built an interactive demo so you can explore how the model can generate DNA sequences, investigate the structure of genes, predict the effect of mutations, generate and fold proteins and even reconstruct parts of the tree of life. huggingface.co/spaces/Hugging… Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 2 🔄 1 ❤️ 4 👀 426 📊 2 ⚡