Scenario-based planning of design method validation studies and the associated effort

Design method validation is fundamental to ensure that design methods achieve their objectives in the intended situations and are accepted in practice. Although various method validation approaches have been developed, there is still a lack of practical guidance for planning validation studies based on project characteristics. To address this, an intensity map of the validation effort is presented as the core of a scenario-based planning approach. It categorizes projects according to the novelty of the method and the state of research on the problem or the research area, enabling the required validation studies, their sequence and validation criteria to be identified. Thereby, researchers can plan validation studies and estimate the required effort situation-based, allowing for a better alignment with their individual project characteristics before starting studies.