Root Cause Analysis Framework for Intelligent Computing Center
The rapid development of AI technology has greatly increased the demand for computational power, leading many companies to deploy large-scale intelligent computing centers. However, the larger cluster sizes result in more frequent failures, making root cause analysis more challenging. To address these issues, we propose ASeqRCA, a novel framework for root cause analysis in intelligent computing center. We simplify the complex network structure of intelligent computing clusters and model the relationships between alarms in sequences by frequent-pattern mining and causal learning techniques. With an alarm causal graph, we apply depth-first search to identify potential alarm propagation paths. We illustrate the effectiveness of the proposed method through a real-world AI model training failure case.
Authors
- Yiyue Wang (ORCID: https://orcid.org/0000-0001-9608-6424)
- Junpeng Lin (ORCID: https://orcid.org/0009-0000-5835-5769)
- Yifei Gao (ORCID: https://orcid.org/0009-0000-4652-086X)
- Ke Lin (ORCID: https://orcid.org/0000-0002-3429-5877)
- Dandan Miao
- Jiantao Ye (ORCID: https://orcid.org/0000-0002-4317-7565)
- Chen Zhang (ORCID: https://orcid.org/0000-0001-6258-5524)
- Y Zhang
Institutions
- Huawei Technologies (China) (CN)
- Songshan Lake Materials Laboratory (CN)
- Tsinghua University (CN)
Publication Details
- Published
- 2024-12-27
- DOI
- https://doi.org/10.1109/icairc64177.2024.10900091
- Primary Topic
- Data Mining Algorithms and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00