llama.cpp v1.0.0 正式发布,Cohere 宣布接入支持
跑了这么多年本地模型,llama.cpp 终于出了 1.0 稳定版, 手机笔记本都能跑。Cohere 还主动把自家模型架构接了进来, 说明厂商也开始抢这条本地部署通道了。经常自己部署模型的朋友可以升级试试。
llama.cpp 发布 v1.0.0,这是这个本地运行 AI 模型的最常用库首个完全稳定的大版本。Hugging Face CEO Clement Delangue 与项目维护者 gggerganov 联合宣布了这一消息,强调 v1 支持各类硬件、平台和模型类型,让用户可以在手机、笔记本和工作站上免费本地运行模型,数据不出本地。
Cohere 也宣布近期已将 llama.cpp 支持集成进其 North Micro Vision 产品,保证其最新架构全部可被 llama.cpp 运行,并承诺后续提供更多开发者支持。Cohere 此举表明开源推理生态对模型厂商的价值:一个库覆盖从消费级设备到工作站的部署场景。
llama.cpp 长期是本地推理的事实标准,v1.0.0 的稳定版发布降低了个人和企业自托管模型的门槛,也是开源社区在推理基础设施层与集中式云端方案的一次对照。
Building open means everybody wins. We’re so happy to see llama.cpp v1.0.0 available. We recently added llama.cpp support into North Micro Vision, ensuring our latest architectures are now all supported 🦙 More Cohere dev support coming soon! clem 🤗 @ClementDelangue We’re not going to win by lobbying, plotting, or manipulating. We’re going to win by building, in the open, with the whole community! Today, with @ggerganov we’re super excited to announce the release of llama.cpp v1, the first major fully stable version of the most used library to run AI models locally, meaning on your phone, your laptop, and your workstation. It means you can own your intelligence for free, not send your data to anyone and be 100% in control, wherever you are in the world. It shows our commitment to support every hardware, platform and model type out there and makes AI distributed rather than concentrated in a few Silicon Valley orgs. Huge thanks to the team, the long-time maintainers and every contributor who helped make this happen. Let’s build! 💛🧡💚 🔗 View Quoted Tweet📊 3 ⚡
This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include llama.cpp, Cohere, Hugging Face, local deployment.
Source attribution: curated from Cohere (@cohere).