LLM-based approach for falsifying cyber-physical systems
Large Language Models as Falsifiers for Cyber-Physical Systems
For those working on safety-critical systems, this research provides a new approach to verifying system specifications, potentially improving the efficiency of safety testing.
This paper introduces LLM-Falsifier, an LLM-based method that finds counterexamples to formal specifications in cyber-physical systems. It outperforms existing tools on 14 of 21 ARCH-COMP benchmarks by requiring fewer simulations to find a counterexample.
Large Language Models as Falsifiers for Cyber-Physical Systems
Falsification searches for counterexamples to formal specifications in cyber-physical systems (CPS). With specifications written in Signal Temporal Logic (STL), falsification can be formulated as a robustness optimization problem, traditionally tackled with black-box search algorithms. In parallel, large language models (LLMs) have recently emerged as surprisingly effective optimizers when coupled with iterative prompting. In this work, we connect these ideas and introduce LLM-Falsifier, an LLM-based approach that falsifies specifications by minimizing the STL robustness degree. Beyond generic prompt-based optimization, our key idea is to expose the LLM to semantic information that is natural for language models but absent from standard numerical optimizers, including natural-language input and output names, output trajectories, and critical-time witnesses for the minimum robustness value. These additions enable smarter and more sample-efficient robustness search. On the ARCH-COMP falsification benchmarks, LLM-Falsifier is shown to outperform existing falsification tools based on a range of optimization paradigms, from surrogate-based and Bayesian optimization to search-based testing, on 14 of 21 specifications when measured by the average number of simulations required to find a counterexample.
