Web-based Evaluation of Modeling Language Notations

This thesis addresses the challenge of evaluating and improving the semantic transparency of graphical notations of conceptual modelling languages. Traditional approaches to modelling language specifications must consider essential notational aspects to effectively reflect domain-specific requirements. We propose a graphical notation evaluation platform for empirical graphical notations evaluation to automate the setup, execution, and result analysis of evaluation experiments, thereby enhancing reproducibility and efficiency. By employing the Design Science Research methodology and agile development methods, we aim to evaluate the built artefacts. Our goal is to investigate how certain platform features enhance semantic transparency evaluation.The evaluation technique comprises initiation, term association, notation association, case study, and feedback tasks. Our system, leveraging advanced image recognition and text recognition techniques, not only advances proposals for new notations but also significantly improves evaluation efficiency. We strive to meet critical requirements such as efficient customization, notation improvement, and participant involvement while effectively addressing the limitations of traditional paper-and-pen setups.