Meta Muse Spark Open 可在两台 Apple M5 Ultra Mac Studio 上运行
Meta 这个模型专门针对本地硬件做了优化,两台 Mac Studio 就能跑,还支持 llama.cpp、vLLM 等一堆引擎,想本地部署的可以看看。
Meta 表示 Muse Spark Open 经过优化,可在两台 Apple M5 Ultra Mac Studio 上用最新 MLX 框架运行。该模型同时支持 SGLang、vLLM、TensorRT-LLM、Hugging Face Transformers、llama.cpp 和 Unsloth 等主流推理引擎,覆盖 AMD、Apple、Intel、NVIDIA 芯片。开发者还可通过 PyTorch 的 TorchTitan 对模型进行微调。
To help make advanced models more accessible, Muse Spark Open is optimized to run on two Apple M5 Ultra Mac Studios with the latest MLX framework. It also runs on leading inference engines like SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, llama.cpp, and Unsloth with optimizations for AMD, Apple, Intel, and NVIDIA silicon. Developers can further customize the model with PyTorch, including TorchTitan for fine-tuning. 💬 1 🔄 0 ❤️ 10 👀 792 📊 2 ⚡