Qwen3.8-27B 可在 17GB 内存本地运行,Unsloth 发布量化版

27B on 17GB RAM. Are you ready to create something incredible? 😎 Thanks for highlighting it! @Unslo...

精选理由

Qwen3.8-27B 现在靠 Unsloth 动态量化,17GB 内存就能跑,还有 NVFP4 量化版,适合本地尝鲜。

AI 摘要

Qwen3.8-27B 是阿里 Qwen 团队的新模型,Unsloth 已支持其在 17GB 内存下通过 Dynamic GGUF 格式本地运行。Unsloth 还上传了 NVFP4 量化版本,模型文件已发布到 Hugging Face 的 unsloth/Qwen3 仓库。官方称该模型在同尺寸中表现最强,但原文没有给出具体基准分数。用户可以参考 Unsloth 文档中的运行指南来部署。

原文 · 阿里通义 Qwen

27B on 17GB RAM. Are you ready to create something incredible? 😎 Thanks for highlighting it! @Unslo...

27B on 17GB RAM. Are you ready to create something incredible? 😎 Thanks for highlighting it! @UnslothAI Unsloth AI @UnslothAI Qwen3.8-27B can now be run locally! ✨ Run on 17GB RAM via Unsloth Dynamic GGUFs. Qwen3.8-27B is by far the strongest model for its size. We also uploaded NVFP4 quants. GGUF: huggingface.co/unsloth/Qwen3.… Guide: unsloth.ai/docs/models/qw… 🔗 View Quoted Tweet 💬 17 🔄 19 ❤️ 264 👀 15509 📊 40 ⚡