Verifying Vision-Based Autonomy with Abstract Rendering and Perception Contracts
Vision-based autonomous systems are increasingly deployed in critical applications, yet verifying them end-to-end remains a formidable challenge due to uncertainties in image formation and the complexity of downstream ML-based perception. While perception contracts have been proposed to address this issue by bounding the possible outputs of a perception module, their guarantees are typically probabilistic. In this work, we propose a novel approach that integrates perception contracts with abstract rendering---a technique that computes rigorous, interval-based over-approximations of all possible rendered images under camera and scene uncertainties---to enable formal verification of vision-based autonomous systems.
Authors
- Yangge Li (ORCID: https://orcid.org/0000-0003-4633-9408)
- Sayan Mitra (ORCID: https://orcid.org/0000-0002-6672-8470)
- C. Ji (ORCID: https://orcid.org/0009-0002-4092-4956)
Institutions
- University of Illinois Urbana-Champaign (US)
Publication Details
- Published
- 2025-05-06
- DOI
- https://doi.org/10.1145/3716550.3725157
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Aeronautics and Space Administration
- Nuclear Safety and Security Commission