Parallel Processing of Power System Operation Data Based on MapReduce Algorithm
The transition to large-scale new energy systems has greatly increased the complexity, volume, and multidimensionality of power data in the cloud, making data management more challenging and potentially risking the safe and stable operation of power systems. To tackle this, the paper proposes a power grid data analysis method using the MapReduce algorithm for efficient data processing. Results show that, even with large data volumes, processing efficiency is maintained at around 30 minutes, with stability and accuracy preserved as data volume grows. This method allows for parallel analysis of the grid and provides valuable insights for future data processing in power grid operations.
Authors
- Hao Tang (ORCID: https://orcid.org/0000-0002-6973-8121)
- Yulei Luo (ORCID: https://orcid.org/0000-0001-9467-4097)
- Pu Yu (ORCID: https://orcid.org/0000-0002-5513-7632)
- Jiyou Zhong (ORCID: https://orcid.org/0000-0003-2817-6617)
- Tao Song (ORCID: https://orcid.org/0000-0002-5965-3140)
Institutions
- PowerChina (China) (CN)
- Yalong Hydro (China) (CN)
- China Power Engineering Consulting Group (China) (CN)
Publication Details
- Published
- 2024-10-25
- DOI
- https://doi.org/10.1109/icemce64157.2024.10862657
- Primary Topic
- Power Systems and Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.00