论文精选

DataCOPE:无监督技能发现框架提升数据分析智能体性能

Unsupervised Skill Discovery for Agentic Data Analysis

精选理由

做数据分析智能体或自动化数据探索的团队,DataCOPE 解决了技能发现依赖昂贵标注的痛点,无需人工干预就能自动提炼可复用技能,建议关注其验证器设计思路。

AI 摘要

DataCOPE 是一种无监督的验证器引导技能发现框架,旨在从无标签探索轨迹中自动提取可复用的数据分析技能,无需更新模型参数。它通过协调数据分析智能体、无监督验证器和技能管理器三个组件,分别处理报告式和推理式分析任务。在报告式分析中,使用自适应检查表验证器动态生成评分标准;在推理式分析中,采用答案一致性验证器利用自一致性作为辅助信号。在 Deep Data Research 和 DABStep 基准测试中,DataCOPE 在报告式和推理式任务上分别平均提升 9.71% 和 32.30% 的得分。该方法为构建更高效的数据分析智能体提供了轻量级且可扩展的解决方案。

原文 · arXiv cs.AI

Unsupervised Skill Discovery for Agentic Data Analysis

Inference-time skill augmentation provides a lightweight way to improve data-analytic agents by injecting reusable procedural knowledge without updating model parameters. However, discovering effective skills for data analysis remains challenging, as reliable supervision is expensive and success criteria vary across analytical formats. This raises the key question of how to discover reusable data-analysis skills from unlabeled exploration alone. We propose DataCOPE, an unsupervised verifier-guided skill discovery framework for data-analytic agents. DataCOPE derives verifier signals from the exploration trajectories and uses them to characterize relative quality or aggreement among trajectories. It iteratively coordinates a Data-Analytic Agent for trajectory generation, an Unsupervised Verifier for signal extraction, and a Skill Manager for contrastive skill distillation. For report-style analysis, we instantiate the verifier as an Adaptive Checklist Verifier that derives task-specific criteria, scores reports by verifiable coverage, and iteratively refines the checklist. For reasoning-style analysis, we instantiate it as an Answer Agreement Verifier that groups trajectories by answer agreement and uses self-consistency as an auxiliary signal. We evaluate DataCOPE on report-style analysis from Deep Data Research and reasoning-style analysis from DABStep. Across both settings, DataCOPE consistently improves held-out performance over baselines. Averaged across four model settings, DataCOPE improves the mean score by 9.71% and 32.30% on report-style and reasoning-style tasks respectively.