Medical Image Visualization using Augmented Reality

Medical imaging is used to examine internal structures hidden by the skin and bones, to diagnose and treat disease in the human body. Medical imaging techniques such Computed Tomography (CT scan) and Magnetic Resonance Imaging (MRI) are commonly used when highly detailed cross-sectional images are required for diagnostic purposes. Creating a 3D image or object from 2D images of these modalities is typically achieved by reconstruction of multiple 2D slices or projections and combined to form a thorough view of a body’s internal organ or structure. 2D Images from CT or MRI Scan are stored as DICOM File Type, method used to convert DICOM file set to 3D object is called volume rendering technique. The fusion of 3D imaging with Augmented Reality (AR) and Virtual Reality (VR), called Mixed Reality (MR), technologies completely revolutionize medical education, surgical planning, and patient interaction. As part of project study and research, a prototype software application for android systems is developed as a proof of concept. A DICOM File Set of scapula bone is used to create a 3D Holographic Object of a human bone structure and projected into the real world. Market research of such software is conducted as part of the study to tap accurately the requirements, usage as well as limitations of the developed software application prototype.