ModelsOfficial

qwenGPU:把 4 通道 SIMT GPU 编译进 Qwen3.5-2B 权重

Meet qwenGPU: Qwen3.5-2B With 45 Compiled GPU Layers That Run CUDA

Why we picked it

阿里 Qwen 团队把一个小 GPU 直接编进 2B 模型权重里,模型自己写 CUDA,玩法挺硬核,喜欢底层架构的可以看看。

qwenGPU 在 Qwen3.5-2B 中以 45 个未训练层的形式编译进一个 4 通道 SIMT GPU。该模型能自己写出真实 CUDA launch 的每一步,用 Gated DeltaNet 的状态充当寄存器和内存。这意味着推理过程本身就是一次 GPU 指令的执行,而非调用外部硬件模拟器。

Image · marktechpost
Original · marktechpost

Meet qwenGPU: Qwen3.5-2B With 45 Compiled GPU Layers That Run CUDA

qwenGPU compiles a 4-lane SIMT GPU into Qwen3.5-2B as 45 untrained layers. The model writes every step of real CUDA launches itself, using Gated DeltaNet state as registers and memory. The post Meet qwenGPU: Qwen3.5-2B With 45 Compiled GPU Layers That Run CUDA appeared first on MarkTechPost .