想了解怎么让GUI智能体更可控？这篇论文讲了Plover系统，能把内部计划展示出来让你改，实验证明能修好很多翻车案例，比黑箱靠谱多了。
Plover是一种以计划为中心的视觉GUI自动化系统。它通过规划-执行架构将任务计划外化为可检查、可修改的工件。在六名参与者的形成性研究基础上，Plover支持自然语言指导和截图干预。实验表明，许多自主GUI智能体的失败可通过可见计划和局部干预进行结构性修复。
Plover: Steering GUI Agents through Plan-Centric Interaction
Graphical user interface (GUI) automation remains challenging in real-world environments, where dynamic layouts, unexpected dialogs, and evolving interface states can cause autonomous agents to drift from user intent. Recent vision-based multimodal agents improve flexibility by operating directly over screenshots and natural language instructions, but planning and adaptation often remain internal, limiting users' ability to inspect, supervise, or correct system behavior. We present Plover, a plan-centric vision-based GUI automation system that externalizes task plans and replanning as persistent, inspectable, and revisable artifacts. Through a planner--executor architecture, Plover supports explicit supervision of evolving execution, localized correction through editable plans, natural-language guidance, and screenshot-grounded interventions, while preserving prior progress during repair. A formative study with six participants informed the interaction design. We then evaluate Plover through benchmark failure-case repair and scenario-based workflow analyses. Our results show that many autonomous GUI-agent failures are structurally repairable when plans remain visible and interventions are localized, and that explicit replanning helps make GUI automation more transparent, controllable, and adaptable.