LLM and ΧR Remote Maintenance Tool for Empowering Operator 5.0

Industry 5.0 has become a reality on a global scale, highlighting the need to develop, integrate, and advance cutting-edge digital technologies to achieve a more human-centric, robust, and resilient industry. Industrial maintenance is, by default, a complex challenge that has been gaining more attention in recent years, following the rise of AI tools and algorithms. Furthermore, eXtended Reality (XR) has also advanced in ways that facilitate Human-Machine Interaction (HMI). Therefore, in this research work, a framework for real-time remote maintenance assistance is presented, comprising an XR module that supports video calls, as well as a fine-tuned Large Language Model (LLM) for improving HMI. Validation results indicate that the developed tool enhances the user experience during maintenance activities and that the fine-tuned LLM is capable of providing specific tasks based on user requests.