ABSTRACT NUMBER: ESOC2026A1123 STANDARD OPERATING PROCEDURE FOR TRUSTWORTHY AI DEVELOPMENT AND VALIDATION IN STROKE
Abstract Background and aims Artificial intelligence (AI)–based clinical decision support systems (CDSS) are increasingly explored in acute stroke care. While high-level principles for trustworthy AI (TAI) exist, practical guidance for implementing these principles is limited. This hinders safe clinical adoption. We aimed to provide a transparent and reproducible framework to translate TAI principles into practice for CDSS in stroke care. Methods Within the EU Horizon project “VALIDATE”, we applied a multi-method approach to operationalize TAI in stroke CDSS development. We conducted participatory co-creation workshops, an external expert assessment using the Z-Inspection methodology®, semi-structured interviews with domain experts, and bi-annual internal audits with work package leads to elicit project-specific requirements. Results We identified key steps for the development and validation of TAI in stroke care. Early stakeholder engagement enables translation of ethical principles into concrete system specifications. Continuous internal governance and structured feedback mechanisms facilitate monitoring of ethical requirements and timely issue identification. Together, these processes improve transparency and align ethical governance with technical and clinical workflows. We further identified practical challenges - such as resource availability, hospital infrastructure, patient recruitment, and timing - along with recommendations for addressing them. We consolidated these findings into a comprehensive Standard Operating Procedure (SOP). Conclusions Our work provides a practical, process-oriented guide for TAI development and validation. The SOP will support future projects, helping to enhance trustworthiness, transparency and clinical safety of CDSS in stroke care. Conflict of interest All listed authors, main, presenting and other: Nothing to disclose.
Authors
- Adam Hilbert (ORCID: https://orcid.org/0000-0003-3447-5453)
- Vince I. Madai (ORCID: https://orcid.org/0000-0002-8552-6954)
- Susanne Bonekamp (ORCID: https://orcid.org/0000-0001-9681-5973)
- Giorgio Colangelo (ORCID: https://orcid.org/0000-0003-2454-9076)
- Luis M. López-Ramos (ORCID: https://orcid.org/0000-0001-8072-3994)
- Dietmar Frey (ORCID: https://orcid.org/0000-0001-5407-2331)
- Riana Minocher (ORCID: https://orcid.org/0000-0002-4614-1859)
- Shahan Tariq
- Gabriele Pluktaite
- Ingo Werren
- Isabel Velarde
- Mercedes Ayesta
- Malte von Tottleben
- John Kelleher
- Maria Victoria Sala Sanz
- Valerie Bürger
- Marta Rubiera
- Ronen R Leker
Institutions
- Hebron University (PS)
- Trinity College Dublin (IE)
- Heidelberg University (DE)
- Hadassah Medical Center (IL)
- University Hospital Heidelberg (DE)
- Vall d'Hebron Institut de Recerca (ES)
- Northern Ohio Recovery Association (US)
- Digital Science (United States) (US)
- empirica - Communication and Technology Research (DE)
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin (DE)
- Simula Metropolitan Center for Digital Engineering (NO)
- Chirurgische Universitätsklinik Heidelberg (DE)
- Charité - Universitätsmedizin Berlin (DE)
Publication Details
- Journal
- European Stroke Journal
- Published
- 2026-05-01
- DOI
- https://doi.org/10.1093/esj/aakag023.564
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00