ParetoSaddler optimizes agent harnesses for quality and cost
The design lesson is that multi-objective optimization in agent pipelines can backfire when applied too early — deferring the cost criterion until final selection preserves valuable intermediate candidates. Builders running agent harness or prompt searches should add repeated runs and a cost axis to their selection step. The arXiv paper (2611.02079) and dair.ai's Chat with Paper make it easy to replicate the setup.