精选理由
PrismML把27B模型压到4GB还能跑在iPhone上，苹果都在试，看看本地AI能有多强。
PrismML将27B参数模型Bonsai 27B压缩至4GB以下，使其能在iPhone上本地运行。在内部基准测试中，最小版本保留原模型90%的性能，数学和编码分数几乎未受影响。Apple据报正在测试该压缩技术，有望推动端侧AI发展。Bonsai 27B是一个完全开源的推理模型。
原文 · Decoder
Bonsai 27B is a full open reasoning model that fits on an iPhone
PrismML has compressed a 27-billion-parameter AI model to under 4 GB, small enough to run on an iPhone. In the company's own benchmarks, the smallest version keeps 90 percent of the original performance, with math and coding scores barely affected. Apple is reportedly already testing the compression technology, which could help it close the gap in on-device AI. The article Bonsai 27B is a full open reasoning model that fits on an iPhone appeared first on The Decoder .