Towards Repository-Level Program Verification with Large Language Models
Recent advancements in large language models (LLMs) suggest great promises in code and proof generations. However, scaling automated formal verification to real-world projects requires resolving cross-module dependencies and global contexts, which are crucial challenges overlooked by existing LLM-based methods with a special focus on targeting isolated, function-level verification tasks. To systematically explore and address the significant challenges of verifying entire software repositories, we introduce RVBench, the first verification benchmark explicitly designed for repository-level evaluation, constructed from four diverse and complex open-source Verus projects.
Authors
- Xujie Si (ORCID: https://orcid.org/0000-0002-3739-2269)
- Si Cheng Zhong
Institutions
- University of Toronto (CA)
Publication Details
- Published
- 2025-10-09
- DOI
- https://doi.org/10.1145/3759425.3763382
- Primary Topic
- Parallel Computing and Optimization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Canadian Institute for Advanced Research
- Natural Sciences and Engineering Research Council of Canada