The path to trustworthy medical AI: the evolving role of explainability
The integration of artificial intelligence (AI) in medicine has applications across several clinical domains, spanning from disease prevention and diagnosis through treatment and long-term care, as well as remote care. However, many AI systems are inherently characterized by limited explainability, meaning the processes behind their outcomes cannot be clearly understood or communicated to humans, whether developers or end users. This viewpoint explores the importance of AI explainability in medicine by first tracing its evolution from a primarily ethical concern to a legal requirement. It then examines the connection between explainability and the trustworthiness of AI systems. Finally, it considers how explainability is approached from a technical standpoint and its inherent tension with achieving high accuracy.
Authors
- Luigi De Angelis (ORCID: https://orcid.org/0009-0005-6136-6596)
- Paola Di Maio (ORCID: https://orcid.org/0000-0003-0770-3713)
- Francesco Andrea Causio (ORCID: https://orcid.org/0000-0002-6545-3196)
- Fidelia Cascini (ORCID: https://orcid.org/0000-0001-6499-0734)
- Alice Ravizza (ORCID: https://orcid.org/0000-0003-2368-7258)
- Valerio De Vita (ORCID: https://orcid.org/0000-0002-1483-8440)
- Luca Bolognini (ORCID: https://orcid.org/0000-0001-6319-6723)
- Giacomo Diedenhofen (ORCID: https://orcid.org/0009-0008-2838-9771)
- Diana Ferro (ORCID: https://orcid.org/0000-0003-1774-7509)
- Francesco Baglivo (ORCID: https://orcid.org/0000-0001-9391-7966)
- Margherita Daverio (ORCID: https://orcid.org/0000-0001-9874-9922)
- Marcello Di Pumpo (ORCID: https://orcid.org/0000-0003-3037-0726)
- Noemi Conditi
- Francesca Aurora Sacchi
- Alessandro Belpiede
- Alessio Pivetta
Institutions
- Università Cattolica del Sacro Cuore (IT)
- Libera Università Maria SS. Assunta (IT)
- Società Italiana di Fisica (IT)
- Italian Society of Physiotherapy (IT)
- Società Italiana di Reumatologia (IT)
- Artificial Intelligence in Medicine (Canada) (CA)
Publication Details
- Journal
- Recenti Progressi in Medicina
- Published
- 2025-10-01
- DOI
- https://doi.org/10.1701/4573.45774
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00