Together AI Triples StepFun Step 5 Serving Throughput
The interesting part is the method: AI agents drove the search across routing, scheduling and kernel-level changes, with a strict benchmark-before-merge loop — a reproducible pattern for anyone running inference infrastructure. Teams serving MoE models can apply the same TTFT- and TPS-targeted workflow. StepFun is a Chinese lab, so its models being served at scale on a US stack also signals deepening cross-border infrastructure ties.
