Brain Digital Twin Combining Artificial Intelligence and Extended Reality

Advances in Artificial Intelligence (AI) with higher computational power and better cloud computing significantly impacted healthcare, enabling the development and implemen-tation of Intelligent Reality (IR) infrastructures combining AI, Digital Twins (DT), and eXtended Reality (XR). We present cutting-edge IR infrastructure designed for healthcare, leveraging the Microsoft Azure cloud environment and integrating DT, AI pipelines, and visualization within XR environments. Our system aims to improve data interpretation, communication, and visualization for clinical neurology, as neurological conditions are among the leading causes of death worldwide. Our infrastructure design was tested using a Brain Digital Twin within an XR environment (Brain-DTXR). Our system combines multimodal data, Electroencephalogram (EEG) and Magnetic Resonance Imaging (MRI), which are harmonized via the Fast Healthcare Interoperability Resources (FHIR) standard. Our system enables interaction with a Brain DT to allow the visualization of complex data within an XR environment. The Brain-DTXR proposed demonstrates the potential of the IR system to enhance data understanding, improve communication and visualization, and lead to more informed decision-making within healthcare while highlighting future research areas.