精选理由
腾讯把295B的模型压到1-bit和4-bit，单卡就能跑，用llama.cpp就能玩，赶快试试。
腾讯混元发布了Hy3的1-bit和4-bit量化版本，该模型拥有295B参数。通过1-bit和4-bit量化，模型可在单张GPU上运行，大幅降低硬件门槛。支持使用llama.cpp进行推理，并启用MTP（多token预测）功能。模型以GGUF格式提供下载，用户可快速体验。
原文 · Hunyuan
Can't Find Benchmark and download link ? See here 👇https://t.co/2bYLI8HRus
Can't Find Benchmark and download link ? See here � huggingface.co/AngelSlim/Hy3-… s Tencent Hy @TencentHunyuan We’ve just released the 1-bit & 4-bit version of Hy3, a flagship-scale 295B model that can be served on a single GPU. 👌 Run Hy3 with llama.cpp, enable MTP, and experience powerful intelligence on dramatically lower hardware.🚀🚀🚀 Can’t wait to see what you buil #Hy3 # #Hy #GGUF G #llamacpp acpp 🔗 View Quoted Tweet 💬 0 🔄 3 ❤️ 17 👀 2769 📊 3 ⚡