Models

百度发布开源基座模型 ERNIE 5.5 Flash Base:2800 亿参数 MoE 架构

Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model

Why we picked it

百度这次放了个 2800 亿参数的开源基座,没做微调就交给你,想怎么调就怎么调,搞微调的朋友可以上手试试。

百度开源 ERNIE 5.5 Flash Base 基础模型,采用 MoE 架构,参数规模 2800 亿。该模型使用 33.5 万亿 token 完成预训练,且刻意未做指令微调。开发者可以在此基础上自行微调,决定模型的最终用途。

Original · Decoder

Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model

Baidu releases ERNIE 5.5 Flash Base: a 280-billion-parameter MoE model pre-trained on 33.5 trillion tokens, shipped deliberately without fine-tuning, so developers can take it wherever they want. The article Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model appeared first on The Decoder .