SGLang adds scoring API and multi-item scoring for decision models
Classification and ranking workloads waste GPU cycles recomputing shared context per candidate, and MIS cuts that cost by an order of magnitude at higher candidate counts. Developers serving scoring endpoints for agent action selection or reranking can switch to /v1/score and measure the p95 gains directly using the benchmark commands in the blog. The LinkedIn contribution shows production demand for this pattern beyond the LMSYS ecosystem.
