Run-time Quantitative Operational Monitoring for BDI Agents
The BDI (Belief-Desire-Intention) agent paradigm has been used to model decision-making in autonomous systems that operate with little to no human intervention, reasoning with beliefs, desires, and intentions on-the-fly to achieve goals. Since BDI agents are used to make decisions in safety-critical systems, verifying that they make correct decisions is vital. Existing design-time verification techniques are effective before deployment, but they cannot capture how agent behaviour evolves during execution, especially under imprecise actuation and probabilistic decision-making. This paper bridges the gap between design-time and run-time verification of probabilistic BDI agents. We propose a run-time quantitative operational monitoring methodology based on Discrete-Time Markov Chains (DTMCs), integrating execution traces with probabilistic model checking. Our approach constructs a DTMC representation of possible agent behaviours at design time, then incrementally updates it using observed execution traces to provide situational insight into agent operation. To demonstrate our work, we contribute a probabilistic BDI language extension, explicate our approach through smart manufacturing for probabilistic BDI agents, and use a rover case study to show the generality of our DTMC-based monitoring. We further implement this monitoring mechanism and evaluate its efficiency and scalability experimentally. This advances agent verification from pre-deployment analysis to ongoing quantitative assurance under uncertainty.
Authors
- Angelo Ferrando (ORCID: https://orcid.org/0000-0002-8711-4670)
- Mengwei Xu (ORCID: https://orcid.org/0000-0003-4978-3061)
- Marie Farrell (ORCID: https://orcid.org/0000-0001-7708-3877)
Institutions
- University of Modena and Reggio Emilia (IT)
- University of Manchester (GB)
- Newcastle University (GB)
Publication Details
- Journal
- ACM Transactions on Software Engineering and Methodology
- Published
- 2026-07-28
- DOI
- https://doi.org/10.1145/3833871
- Primary Topic
- Safety Systems Engineering in Autonomy
- Type
- article
- Field-Weighted Citation Impact
- 0.00