From <scp>AI</scp> to the Era of Explainable <scp>AI</scp> in Healthcare 5.0: Current State and Future Outlook

ABSTRACT Artificial intelligence (AI) and explainable artificial intelligence (XAI) are advancing rapidly, with the potential to deliver significant benefits to modern society. The healthcare sector, in particular, has experienced transformative changes; overall, these technologies are helping to address numerous challenges, such as cancer cell detection, tumour zone identification in animal bodies, predictions of major and minor diseases, diagnosis, and more. This article provides an in‐depth and detailed overview of AI and XAI, focusing on recent trends and their implications for advancing Healthcare 5.0 applications. Initially, the study examines the key concepts and exceptional features of AI, XAI, and Healthcare 5.0. Additional emphasis is placed on state‐of‐the‐art practices currently being implemented in healthcare, particularly those involving AI and XAI. Subsequently, it establishes a coherent link between AI and XAI in Healthcare 5.0, grounded in contemporary advancements. Based on the findings, algorithms are recommended to address initial obstacles to integrating AI into the Healthcare 5.0 framework. Proposals for further enhancing Healthcare 5.0 performance through the integration of XAI and its unique features are discussed in detail. The work also provides in‐depth implementation strategies and highlights model‐specific trends within AI and XAI frameworks in Healthcare 5.0. Particular attention is given to AI model predictions in healthcare settings, emphasising their contributions to improved patient feedback and the delivery of more sophisticated care. Most importantly, this research highlights the potential for AI and XAI to support sustainable advancements in Healthcare 5.0 applications. Finally, significant issues are analysed, and an open discussion is presented on future guidelines for the blending of AI with XAI, and Healthcare 5.0 applications.