Task-oriented hybrid learning for robotic skill acquisition and control
Accurate execution of metrological applications and complex manipulation tasks remains a significant challenge in smart manufacturing systems. Although tele-operated and pre-programmed robots improve efficiency and safety, their dependence on expert control and limited adaptability in dynamic environments restrict their deployment. To address this, we propose a task-oriented hybrid hierarchical learning framework to facilitate robot skill acquisition. This framework integrates imitation rewards from expert demonstrations with task rewards from environmental interactions, enabling more purposeful exploration and improved learning efficiency. It combines Behavioural Cloning (BC), Generative Adversarial Imitation Learning (GAIL), Proximal Policy Optimization (PPO), and Virtual Reality (VR) technology. Training involves two phases: first, VR expert demonstrations are used with BC to establish an initial policy; second, this policy is refined using PPO, incorporating both external rewards from the environment and internal rewards from the GAIL discriminator. Numerical experimental evaluations on three manipulation tasks demonstrate our method’s effectiveness, achieving high success rates and robust performance in challenging scenarios.
Authors
- Olivier Bruneau (ORCID: https://orcid.org/0000-0002-3485-2186)
- Xinping Gu (ORCID: https://orcid.org/0000-0003-2629-6949)
- Charyar Mehdi-Souzani (ORCID: https://orcid.org/0000-0003-3049-2176)
Institutions
- Université Paris-Saclay (FR)
- Sorbonne Université (FR)
- Université Sorbonne Paris Nord (FR)
Publication Details
- Journal
- Procedia CIRP
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1016/j.procir.2025.08.173
- Primary Topic
- Robot Manipulation and Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Université Paris 13