做AI安全与合规的团队终于有了可落地的形式化方法方案——LTL+小模型就能超越LLM裁判，建议做AI治理的开发者直接看实验部分。
这篇论文提出结合形式化方法与机器学习的技术，用于在AI开发生命周期中审计和监控高级AI系统（尤其是LLM）的合规性。方法包括离线审计、在线运行时监控，以及预测性和干预性监控器，能在运行时提前预防违规。实验表明，基于线性时序逻辑（LTL）的方法在检测时序行为约束违规方面优于纯LLM基线，小模型也能匹配或超越前沿LLM裁判。干预监控器在保持任务性能的同时显著降低了LLM智能体的违规率。研究还发现，LLM的时序推理能力随事件距离、约束数量和命题数量增加而显著下降。
Formal Methods Meet LLMs: Auditing, Monitoring, and Intervention for Compliance of Advanced AI Systems
We examine one particular dimension of AI governance: how to monitor and audit AI-enabled products and services throughout the AI development lifecycle, from pre-deployment testing to post-deployment auditing. Combining principles from formal methods with SoTA machine learning, we propose techniques that enable AI-enabled product and service developers, as well as third party AI developers and evaluators, to perform offline auditing and online (runtime) monitoring of product-specific (temporally extended) behavioral constraints such as safety constraints, norms, rules and regulations with respect to black-box advanced AI systems, notably LLMs. We further provide practical techniques for predictive monitoring, such as sampling-based methods, and we introduce intervening monitors that act at runtime to preempt and potentially mitigate predicted violations. Experimental results show that by exploiting the formal syntax and semantics of Linear Temporal Logic (LTL), our proposed auditing and monitoring techniques are superior to LLM baseline methods in detecting violations of temporally extended behavioral constraints; with our approach, even small-model labelers match or exceed frontier LLM judges. Our predictive and intervening monitors significantly reduce the violation rates of LLM-based agents while largely preserving task performance. We further show through controlled experiments that LLMs' temporal reasoning shows a pronounced degradation in accuracy with increasing event distance, number of constraints, and number of propositions.