ModelsSelected

MiniCPM5-2B-Jev turns MiniCPM5-2B into a decision model

Why we picked it

Instead of prompting a larger model to output text, the model emits calibrated probabilities over fixed options, which suits ticket routing, eligibility checks and criteria scoring where answers must be machine-readable. Developers can pull the Apache 2.0 weights, adapters and scripts, or wire the /v1/systemone API into existing pipelines. At 2B parameters it targets the same slot where teams might otherwise deploy much larger generative models for classification.

Developer @ActbroDev built MiniCPM5-2B-Jev on OpenBMB's MiniCPM5-2B, adapting it into a System 1 decision model that returns probabilities for predefined options instead of free-form text. The project reports 78.79% on JevBench, ranking first among open-weight System 1 / Jev models at or below 2B parameters, plus 86.41% accuracy and 0.0307 ECE on the decision-v7 benchmark. It ships under Apache 2.0 with open-source code, LoRA adapters, a calibration head, training and evaluation scripts, a /v1/systemone decision API, and KV-cache reuse across questions sharing context.

Original · OpenBMB

What if your model could make a structured choice instead of writing another paragraph? 🎯

Developer @ActbroDev built MiniCPM5-2B-Jev on OpenBMB’s MiniCPM5-2B, adapting it into a System 1 decision model.

📄 Give it a document and a set of questions. It returns probabilities for predefined options, without generating a free-form answer—helping developers: - Classify requests and route support tickets - Check whether conditions or requirements are met - Score cases against defined criteria

📊 Results reported by the project: 🏆 78.79% on JevBench, ranking #1 among ≤2B open-weight System 1 / Jev models ✅ 86.41% accuracy on the 10-source decision-v7 benchmark 📏 0.0307 ECE on decision-v7, measuring how closely confidence matches accuracy

🛠️ Built for developers: • Structured decision API via /v1/systemone • Shared-context KV-cache reuse across multiple questions • Open-source code, LoRA adapters, and calibration head under Apache 2.0 • Training and evaluation scripts to explore and reproduce the approach

From support-ticket routing to criteria-based scoring, this project shows how the community is adapting MiniCPM for practical decision workflows. 🌍

🙌 Shout-out to yuting-ai for building and sharing!

🔗 Explore Project: https://t.co/VRkkO4cY7G 🤗 Get MiniCPM5-2B: https://t.co/TNUu629lXn

#MiniCPM #OpenBMB #OpenSourceAI