Papers

TAPES:面向交易事件序列的任务对齐联合预测预训练框架

TAPES: Task-Aligned Joint Predictive Pretraining for Transaction Event Sequences

Why we picked it

一篇搞交易数据预训练的论文,TAPES 会自动挑对下游有用的预测目标,金融风控这类任务上跑赢了基线方法。

TAPES 是一个针对交易事件序列的预训练框架,由候选字段-算子组合构建有限的目标集合。它通过短时联合预训练试验在匹配预算下评估各目标集的下游效用,据此选出目标集。随后重新初始化编码器,用共享离散潜变量参数化的联合似然在选定目标上预训练。在真实交易风控场景和多个公开金融基准上,TAPES 的表现超过代表性基线。消融实验验证了预测目标选择与联合建模的贡献。

Original · arXiv cs.AI

TAPES: Task-Aligned Joint Predictive Pretraining for Transaction Event Sequences

Transaction event sequences support diverse prediction tasks in online commerce and digital financial services. The same transaction records can yield prediction targets with different semantics, including values, changes, and relations to past events. These targets impose different constraints on history representations, but their predictability alone does not establish the downstream utility of a target set. Moreover, target-wise prediction losses do not explicitly model conditional co-occurrence among targets. To address these challenges, we propose TAPES, a task-aligned joint predictive pretraining framework for transaction sequences. TAPES constructs a finite collection of candidate target sets from admissible field-operator combinations. It selects a target set according to the downstream utility of representations learned through short joint pretraining trials under matched budgets. It then reinitializes the encoder and pretrains it on the selected targets through a joint likelihood parameterized by a shared discrete latent variable, before downstream supervised adaptation. Experiments in a real-world transaction-risk setting and on multiple public financial benchmarks spanning diverse downstream tasks demonstrate that TAPES outperforms representative baselines. Ablation studies further validate the contributions of predictive target selection and joint modeling.