Princeton and Google paper: 4B decision model cuts agent costs
Confidence thresholds fitted on your own agent's traces, not generic accuracy, are what decide whether a small router model helps or hurts. Practitioners building tool-using agents can cut costs by training a small decision model on trajectories their own agent actually reaches, mistakes included. Compared with routing every tool call blindly, the thresholded approach preserved success within 3 points.
