Digital Twins for Sophisticated Laboratory Automation for Energy Management and Security

The recent advancements in Digital Twin technologies and their transformative applications across various sectors bring in a new dimension to the Human Computer Interface Domain. Due to the immersive and interactive nature of the Digital Twin applications, we are emphasizing to utilize the advancement for laboratory automation and rehabilitation. The democratization of virtual reality, enabled by cost-effective headgear and the integration of Unity AR technology with the Internet of Things (IoT), has revolutionized the control of home appliances, making it an intuitive and immersive experience. We are proposing a model to control sophisticated laboratories’ power supplies using digital twin technologies integrated with IoT. The Model encompasses a 2D system-based interaction, a Mixed Reality-based interaction, and a Hand Gesture-based interaction, all developed using the Unity Engine and the Leap Motion-SDK. The integration of IoT devices is achieved through NODEMCU, which toggles the status (ON/OFF) of the appliances upon receiving an HTTP request. This comprehensive exploration of the latest VR and AR technologies and their applications provides valuable insights for future research and development in the field. We have evaluated our proposed work quantitatively and qualitatively (through user experiences) and modernized.