Question's Gambit improves research agents
The technique halves calibration error for GPT-5.5 and reduces retrieval errors to just 3 out of 79 cases, making it valuable for developers building research agents.
The paper introduces Question's Gambit, a technique that improves GPT-5.5 from 83.1% to 90.5% on BrowseComp-Plus. It also lifts GPT-5.4-mini from 68.1% to 79.0% and DeepSeek-v4-pro from 71.4% to 76.9%. The method adds between 2.3 and 5.3 extra tool calls per question.
Impressive paper showing how much the first retrieval step matters for deep research agents. It helps to improve GPT-5.5 from 83.1% to 90.5% on BrowseComp-Plus with the same retriever and the same agent loop. It seems that the gain comes from the opening context. The authors propose Question's Gambit which runs once, before the agent starts searching. It splits the question into clues, turns each clue into complementary searches, pools the results, and reranks them. The agent then starts its loop with that ranked set already in context. The same change lifts GPT-5.4-mini from 68.1% to 79.0% and DeepSeek-v4-pro from 71.4% to 76.9%, and roughly halves calibration error for GPT-5.5. It costs between 2.3 and 5.3 extra tool calls per question. In an error analysis, only 3 of the 79 remaining GPT-5.5 errors come from the gold document never being retrieved. The other 76 happen later, when the agent previews, opens or uses the evidence. Paper: arxiv.org/abs/2609.14412 Chat with Paper: academy.dair.ai/papers/questio… 💬 3 🔄 0 ❤️ 2 👀 980 📊 3 ⚡
- arXiv cs.AI09-22 17:40原文