想用AMD显卡跑大模型的可以看看，AMD把16B总参数、2.8B激活的MoE模型全开源了，连训练配置和数据配方都给了。
AMD推出Instella-MoE-16B-A3B，这是一个完全开源的混合专家语言模型，总参数16B，每个token仅激活2.8B。模型采用Gated MLA与FarSkip-Collective架构，在Instinct MI300X和MI325X GPU上从零训练。AMD已发布所有训练阶段的权重，并公开数据混合、配置和推理代码。
AMD Releases Instella-MoE-16B-A3B: A Fully Open Mixture-of-Experts LLM With 2.8B Active Parameters Trained On Instinct GPUs
AMD released Instella-MoE-16B-A3B, a fully open Mixture-of-Experts language model trained from scratch on Instinct MI300X and MI325X GPUs. It holds 16B total parameters but activates only 2.8B per token, using Gated MLA and FarSkip-Collective. AMD published weights from every training stage, plus data mixtures, configs, and inference code. The post AMD Releases Instella-MoE-16B-A3B: A Fully Open Mixture-of-Experts LLM With 2.8B Active Parameters Trained On Instinct GPUs appeared first on MarkTechPost .