Virtual, Augmented, and Mixed Reality Robotics-Assisted Deep Reinforcement Learning Towards Smart Manufacturing

Welding robots are essential in modern manufacturing, providing high precision and efficiency in welding processes. To optimize their performance and minimize errors, accurate simulation of their behavior is crucial. This paper presents a novel approach to enhance the simulation of welding robots using the Virtual, Augmented, and Mixed Reality (VAM) simulation platform. The VAM platform offers a dynamic and versatile environment that enables a detailed and realistic representation of welding robot actions, interactions, and responses. By integrating VAM with existing simulation techniques, we aim to improve the fidelity and realism of the simulations. Furthermore, to accelerate the learning and optimization of the welding robot's behavior, we incorporate deep reinforcement learning (DRL) techniques. Specifically, DRL is utilized for task offloading and trajectory planning, allowing the robot to make intelligent decisions in real-time. This integration not only enhances the simulation's accuracy but also improves the robot's operational efficiency in smart manufacturing environments. Our approach demonstrates the potential of combining advanced simulation platforms with machine learning to advance the capabilities of industrial robots. In addition, experimental results show that ANFIS achieves higher accuracy and faster convergence compared to traditional control strategies such as PID and FLC.