FVRuleLearner: Operator-Level Reasoning Tree (OP-Tree)-Based Rules Learning for Formal Verification

arXiv cs.AI / 4/7/2026

💬 OpinionIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes FVRuleLearner, a domain-specific framework to improve the NL-to-SVA (natural language to SystemVerilog Assertions) step in formal verification, where current LLM approaches often fail due to limited data and FV operator complexity.
  • FVRuleLearner introduces an Operator Reasoning Tree (OP-Tree) that decomposes NL-to-SVA alignment into fine-grained, operator-aware reasoning questions and combines reasoning paths that lead to correct assertions.
  • The method runs in two phases—training to build the OP-Tree from aligned examples and testing to retrieve operator-aligned reasoning traces from the OP-Tree to generate rules for unseen specifications.
  • Experiments report improvements over prior baselines, including +3.95% syntax correctness and +31.17% functional correctness on average.
  • A functional taxonomy analysis shows the approach reduces about 70.33% of SVA functional failures across diverse operator categories, suggesting strong transfer to unseen NL-to-SVA tasks.

Abstract

The remarkable reasoning and code generation capabilities of large language models (LLMs) have recently motivated increasing interest in automating formal verification (FV), a process that ensures hardware correctness through mathematically precise assertions but remains highly labor-intensive, particularly through the translation of natural language into SystemVerilog Assertions (NL-to-SVA). However, LLMs still struggle with SVA generation due to limited training data and the intrinsic complexity of FV operators. Consequently, a more efficient and robust methodology for ensuring correct SVA operator selection is essential for producing functionally correct assertions. To address these challenges, we introduce FVRuleLearner, an Operator-Level Rule (Op-Rule) learning framework built on a novel Operator Reasoning Tree (OP-Tree), which models SVA generation as structured, interpretable reasoning. FVRuleLearner operates in two complementary phases: (1) Training: it constructs OP-Tree that decomposes NL-to-SVA alignment into fine-grained, operator-aware questions, combining reasoning paths that lead to correct assertions; and (2) Testing: it performs operator-aligned retrieval to fetch relevant reasoning traces from the learned OP-Tree and generate new rules for unseen specifications. In the comprehensive studies, the proposed FVRuleLearner outperforms the state-of-the-art baseline by 3.95% in syntax correctness and by 31.17% in functional correctness on average. Moreover, FVRuleLearner successfully reduces an average of 70.33% of SVA functional failures across diverse operator categories through a functional taxonomy analysis, showing the effectiveness of applying learned OP-Tree to the Op-Rule generations for unseen NL-to-SVA tasks. These results establish FVRuleLearner as a new paradigm for domain-specific reasoning and rule learning in formal verification.