上海AI实验室与交大开源NCP-ArchPreview模型
Shanghai AI Lab and SJTU Open-Source NCP-ArchPreview Latent-Space Model
精选理由
上海AI实验室和交大联合发布了这个开源模型，能同时预测下一个概念和下一个词，性能接近7亿参数的基线模型。
上海AI实验室和上海交大联合开源了NCP-ArchPreview模型，这是一个8.9亿参数的隐空间模型，同时训练概念和词预测，在约51.3%的token上达到了7亿基线模型的损失水平。
原文 · pandaily
Shanghai AI Lab and SJTU Open-Source NCP-ArchPreview Latent-Space Model
Shanghai Artificial Intelligence Laboratory and Shanghai Jiao Tong University's LUMIA Lab open-sourced NCP-ArchPreview, an 8.9B latent-space model that jointly trains next-concept and next-token prediction, matching a 7B baseline loss on ~51.3% of tokens.
