Towards good practice In engaging users In evaluation of computer model Software: Introducing the critical appraisal approach (CAA)

Good practices in model software development are essential for boosting uptake. While user-centric approaches are much advocated, challenges remain in including users in development due to diverse definitions for ‘users’, their perceived credibility as an information source, and the influence of market-based innovation choices and the anticipation of (future) demands. While enhancing user feedback could help in addressing these challenges, there is a notable lack of guidance for best practices focused on users, as the emphasis has traditionally been on developers. To tackle this gap, we propose a Critical Appraisal Approach (CAA) for model software evaluation, informed by the Basin Futures model software and detailed steps in its evaluation, thereby providing guidance to support associated best practices for such software. The paper shows the CAA can assist in 1) enhancing shared understanding between users and developers, 2) coordinating development and evaluation, and 3) aligning development with market dynamics. • Aligning development and market processes determines how users should be engaged. • Understanding user needs varies with market-based innovation processes. • Effective evaluation and creating shared understanding require guidance. • We propose a critical appraisal approach to guide users' model software evaluation.