Enhancing Manycore Lifetime Through Reinforcement Learning Task Mapping and Migration
Manycore systems emerged as a solution to the limitations of single-core processors in meeting modern computational demands. Effective task mapping and migration are essential in these systems to optimize computational performance without exceeding the Thermal Design Power (TDP) constraints. Additionally, temperature management is crucial for ensuring the system’s long-term reliability. This research proposes a lightweight and scalable heuristic for reliability-aware task mapping and migration. Our approach employs machine learning techniques, specifically Reinforcement Learning (RL), to optimize system mapping and migration. The proposed method utilizes a lookup table, which is pre-trained using Q-learning. The pre-training enables dynamic task distribution adjustments in response to the task mapping and their power consumption. Experimental results demonstrate that it outperforms other strategies. Our proposed method effectively manages peak temperatures and improves the system’s Mean Time To Failure (MTTF). This study provides a robust framework for task management in manycore systems and sets the groundwork for future explorations into autonomous system optimization.
Authors
- Iaçanã Ianiski Weber
- Vitor Balbinot Zanini
- Fernando Gehm Moraes
Institutions
- Pontifícia Universidade Católica do Rio Grande do Sul (BR)
Publication Details
- Published
- 2024-09-02
- DOI
- https://doi.org/10.1109/sbcci62366.2024.10703980
- Citations
- 1
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 0.35
Funders
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Fundação de Amparo à Pesquisa do Estado do Rio Grande do Sul