An Interaction Paradigm to Facilitate Cardiac and Nerve Anatomy using Augmented and Virtual Reality

This work describes a design methodology for developing an interactive visualization environment using Augmented Reality (AR) based on Head Mounted Displays (HMDs) to provide a learning experience for cardiac and Nerve anatomy. After precise model geometry was obtained by computed tomography imaging techniques and optimized in a 3D modeling software package, photo-realistic texture mapping was achieved by using 3D painting software. Using this strategy makes modeling intricate, organic geometry easier. The Unity game engine was used to provide animation, rendering methods, and augmented reality functionality. The architecture and development of the system depicts complicated learning information, maximizes immersion, and facilitates natural gesture interaction inside a real-world learning environment. An accessible way to illustrate cross-section rendering in augmented reality was achieved by combining hand input with a surgical dissection metaphor. This technique has led to well-directed lessons being learned.