Research on Distributed Storage Algorithm for Multi-Source Survey Data in Power Grid Engineering

With the rapid development of power grid engineering, especially the rapid development of extra-high voltage engineering, the multi-source heterogeneous investigation data is on the increase, and the traditional investigation data storage methods can no longer meet the basic needs. Based on this situation, this paper adopts the consistent hash algorithm to achieve horizontal elasticity expansion of the storage system, and combines the virtual nodes of consistent hash with the weighted polling algorithm to improve the storage strategy of distributed file system (HDFS) under the Hadoop platform, to achieve balanced effect of distributed data storage. Experimental results show that the distributed storage algorithm for heterogeneous survey data from multiple sources proposed in this paper reduces the cluster load difference to different degrees under different conditions, and shows better load balance performance compared to HDFS and ordinary consistent hashing algorithms, which proves that the algorithm can effectively reduce the load difference between cluster nodes and satisfy the needs of distributed storage of power grid engineering survey data.