开源平台 Gricea:让对话式 AI 研究可复现、可复用
Gricea: An Open Science Platform for Conversational AI Research
做对话 AI 实验总缺配置?Gricea 复现了 93% 的 CUI 2026 论文配置,复现难的朋友可以试试。
arXiv 论文提出 Gricea,一个把对话式 AI(CAI)研究封装成可运行、可检查、可复用研究工件的开放科学平台。作者基于对既有 CAI 研究的形成性分析,把实验流程、面向被试的系统与对话任务行为绑定在同一工件里。在复现实验中,Gricea 跑通了 CUI 2026 合格论文中 93% 的实验配置,并发现 96% 的论文缺失阻碍忠实复现的关键信息。用户研究里,不同背景的研究者和从业者用 Gricea 成功搭建出可运行研究,覆盖多种开放性研究问题。
Gricea: An Open Science Platform for Conversational AI Research
We need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders replication, extension, and knowledge accumulation. We present Gricea, an open-science platform representing studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse. Informed by a formative analysis of prior CAI research, Gricea couples study procedures, participant-facing systems, and conversational task behavior in. In a replication study using Gricea, we replicated configurations 93% of eligible CUI 2026 papers; while also flagging missing information in 96% of papers that hinder faithful replication --- further motivating Gricea's need. In a user study, researchers and practitioners from diverse backgrounds successfully constructed runnable studies addressing various open-ended research questions. Together, these findings demonstrate Gricea's support for constructing, reproducing, and extending CAI studies through shared research artifacts, enabling cumulative knowledge building through open science.