P58 An evaluation framework for healthcare professionals’ digital health and AI technologies: evidence-based policy recommendations

Objectives Health systems continue to face mounting challenges for which digital health and AI technologies (DHAITs) can lend a helping hand. However, the lack of consensus on a taxonomy for digital health technologies along with the absence of appropriate value assessment frameworks, particularly for professional-facing solutions, inhibit their value to tackling health system challenges. In this study, we propose a comprehensive evidence-based taxonomy for professional-facing DHAITs, review existing evidence frameworks, highlight their shortcomings and present robust recommendations to evaluate these technologies. Methods The study draws on scoping reviews and thematic analyses to develop a structured taxonomy that reflects the key characteristics of professional-facing DHAITs. It also examines evaluation frameworks put forward by six countries—UK, France, Germany, USA, South Korea, and Canada—to assess their current classification and evaluation proposals. A group of 9 experts were consulted to fine-tune the overall results of the study. Results The proposed taxonomy includes seven core dimensions: interoperability, access platform, driving technology, data inputs, intended impact, intended use case, and intended beneficiary. The consolidated review results in eight policy recommendations stressing the need to align classification with evidence standards, expand HTA frameworks to include system-level impacts, and foster international regulatory cooperation. These recommendations target HTA agencies, notified bodies, international regulatory networks, payers, health ministries and developers, to facilitate remedies required to effectively evaluate these technologies and improve their impact in health systems. Conclusions The proposed taxonomy and review of existing evaluation frameworks contribute to the existing evidence gaps and ongoing work to define the best approach to evaluating DHAITs. Ultimately, properly evaluating DHAITs would ensure that they deliver on their promise to help tackle health system challenges.