这篇论文提出了一个评估LLM智能体在金融合规中规则归因的新方法,值得一读。它通过实验展示了规则指导如何减少违规行为,并强调了监控的重要性。
研究提出ReguSim和ReguBench,用于评估金融市场中LLM智能体在规则归因方面的表现。DeepSeek V4 Pro和Gemini 3.5 Flash在规则指导下减少了违规行为,但未完全消除。激励或角色框架可改变行为。研究表明,除非展示执行证据,否则交易者的理由可能误导独立监控者。在监控中,简单的结构化基线与仅提示的LLM相当或更优。结果将金融合规评估视为对规则归因行动和证据使用的审计,而非单一合规评分。
ReguSim: Evaluating LLM Agent Rule Grounding in Financial Compliance
LLM agents in financial markets may cite rules yet still submit orders that violate executable constraints or misread surveillance evidence. We introduce ReguSim, a controlled financial-compliance environment, and ReguBench, a target-marked monitoring benchmark, to separate four artifacts: stated reasoning, attempted action, execution enforcement, and monitor evidence. In trader runs with DeepSeek V4 Pro and Gemini 3.5 Flash, visible rules reduce but do not eliminate rejected actions, and incentive or persona framing shifts behavior. A bridge study shows that trader rationales can mislead an independent monitor unless enforcement evidence is shown. In monitoring, simple structured baselines either match or exceed prompt-only LLMs. The results frame financial compliance evaluation as an audit of rule-grounded actions and evidence use, rather than a single compliance score.