Verification, validation, and evaluation of modeling methods: experiences and recommendations

Abstract Modern modeling methods are developed in various ways, some following method engineering approaches and principles, others in more ad-hoc ways based on experience, observation, or by exploration of innovative ideas. In all cases, the assessment of the method quality and fitness to the different situations in which it has to serve is a challenge that the method engineers have to face. In this paper, we aim to share knowledge concerning the process of development of modeling methods with an emphasis on systematic approach to verification, validation, and evaluation (VVE). The goal of the paper is to: (1) clarify the differences and key activities and practices of method VVE, (2) to analyze how these have been applied to several modeling methods, and (3) to capture and share key best practices in this process.