Multi-Task Reinforcement Learning for Quadrotors
Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with novel tasks, requiring a complete retraining of the policy from scratch. To address this limitation, this paper presents a novel multi-task reinforcement learning (MTRL) framework tailored for quadrotor control, leveraging the shared physical dynamics of the platform to enhance sample efficiency and task performance. By employing a multi-critic architecture and shared task encoders, our framework facilitates knowledge transfer across tasks, enabling a single policy to execute diverse maneuvers, including high-speed stabilization, velocity tracking, and autonomous racing. Our experimental results, validated both in simulation and real-world scenarios, demonstrate that our framework outperforms baseline approaches in terms of sample efficiency and overall task performance. Video is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://youtu.be/HfK9UT1OVnY</uri>.
Authors
- Jiaxu Xing
- Davide Scaramuzza (ORCID: https://orcid.org/0000-0002-3831-6778)
- Elie Aljalbout (ORCID: https://orcid.org/0000-0003-0590-0043)
- Yunlong Song (ORCID: https://orcid.org/0000-0002-6352-3744)
- Ismail Geles (ORCID: https://orcid.org/0009-0006-2940-0675)
Institutions
- University of Zurich (CH)
Publication Details
- Journal
- IEEE Robotics and Automation Letters
- Published
- 2024-12-23
- DOI
- https://doi.org/10.1109/lra.2024.3520894
- Citations
- 10
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 3.47