论文精选

结构化提示对比研究:清单提示法效果最优

Less Back-and-Forth: A Comparative Study of Structured Prompting

精选理由

做AI提示工程或日常使用LLM的开发者,用清单提示法能直接提升输出质量并省去反复调试的麻烦,建议试试这个简单但有效的技巧。

AI 摘要

这篇论文研究了结构化提示设计是否能提升大语言模型的回答质量并减少用户交互成本。研究者对比了三种提示条件:原始提示、清单改进提示和澄清问题提示,在摘要、规划、解释和编程四种任务上测试了ChatGPT、Claude和Grok三个模型。结果显示,清单改进提示的平均评分最高(7.50/8),远超原始提示(5.67)和澄清问题提示(6.67),且使用的token数更少。研究表明,简单的提示清单就能显著提升回答质量并减少不必要的来回交互。

原文 · arXiv cs.AI

Less Back-and-Forth: A Comparative Study of Structured Prompting

Large language models (LLMs) are widely used for open-ended tasks, but underspecified prompts can lead to low-quality answers and additional interaction. This paper studies whether structured prompt design improves response quality while reducing user effort. We compare three prompt conditions: a raw prompt, a checklist-improved prompt, and a clarifying-question prompt. We evaluate these conditions across four task types--summarization, planning, explanation, and coding--using three LLM systems: ChatGPT, Claude, and Grok. Each output is scored with a unified rubric covering task completion, correctness, compliance, and clarity. Checklist-improved prompts achieved the highest mean rubric score, 7.50 out of 8, compared with 5.67 for raw prompts and 6.67 for clarifying-question prompts. Checklist prompts also produced the best quality-effort tradeoff, using fewer average tokens than both raw and clarifying prompts. These results suggest that a simple prompt checklist can improve LLM responses while reducing unnecessary interaction.