FIT-GGUF builds mixed-precision MiniCPM5-2B GGUF variants
Mixed-precision quantization with a size target lets you hit an exact memory budget rather than settling for whatever Q4/Q5 yields, which matters on edge devices where every few hundred MB counts. Builders running local inference should compare these 1.14–1.46 GiB MiniCPM5-2B builds against their current preset and try FIT-GGUF on their own models. The models are on Hugging Face for direct download.
