Parallel Processing of Power System Operation Data Based on MapReduce Algorithm

The transition to large-scale new energy systems has greatly increased the complexity, volume, and multidimensionality of power data in the cloud, making data management more challenging and potentially risking the safe and stable operation of power systems. To tackle this, the paper proposes a power grid data analysis method using the MapReduce algorithm for efficient data processing. Results show that, even with large data volumes, processing efficiency is maintained at around 30 minutes, with stability and accuracy preserved as data volume grows. This method allows for parallel analysis of the grid and provides valuable insights for future data processing in power grid operations.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/icemce64157.2024.10862657
Primary Topic
Power Systems and Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Parallel Processing of Power System Operation Data Based on MapReduce Algorithm

Hao Tang, Yulei Luo, Pu Yu, Jiyou Zhong et al.
Power Systems and Technologies
article

Parallel Processing of Power System Operation Data Based on MapReduce Algorithm

Hao Tang, Yulei Luo, Pu Yu, Jiyou Zhong, Tao Song
article en

Abstract

The transition to large-scale new energy systems has greatly increased the complexity, volume, and multidimensionality of power data in the cloud, making data management more challenging and potentially risking the safe and stable operation of power systems. To tackle this, the paper proposes a power grid data analysis method using the MapReduce algorithm for efficient data processing. Results show that, even with large data volumes, processing efficiency is maintained at around 30 minutes, with stability and accuracy preserved as data volume grows. This method allows for parallel analysis of the grid and provides valuable insights for future data processing in power grid operations.

PowerChina (China) (CN), Yalong Hydro (China) (CN), China Power Engineering Consulting Group (China) (CN)
Affordable and clean energy
Openalex Percentile: Top 75%
Power Systems and Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.