百度发布开源基座模型 ERNIE 5.5 Flash Base:2800 亿参数 MoE 架构
Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model
百度这次放了个 2800 亿参数的开源基座,没做微调就交给你,想怎么调就怎么调,搞微调的朋友可以上手试试。
百度开源 ERNIE 5.5 Flash Base 基础模型,采用 MoE 架构,参数规模 2800 亿。该模型使用 33.5 万亿 token 完成预训练,且刻意未做指令微调。开发者可以在此基础上自行微调,决定模型的最终用途。
Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model
Baidu releases ERNIE 5.5 Flash Base: a 280-billion-parameter MoE model pre-trained on 33.5 trillion tokens, shipped deliberately without fine-tuning, so developers can take it wherever they want. The article Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model appeared first on The Decoder .