A Genetic Approach to Ensuring the Reliability and Operational Efficiency of Distributed Data Storage in the Digital Industry
In the digital industry, the most promising and effective way to organize a distributed data storage is to use the distributed file system HDFS. The paper proposes an approach to ensuring the reliability and efficiency of distributed storage, which is based on optimizing the file distribution plan in the data storage, taking into account the criteria of reliability and operational efficiency. The proposed approach allows to reduce the response time of the storage system to requests. This is achieved in such a way that the indicator of operational efficiency tends to the maximum, and the reliability indicator is subject to restrictions corresponding to the requirements. The proposed approach consists of four stages: preparation of initial data, formation of preferred file distribution plans at the stages of design and reconfiguration of the storage, search for the optimal file distribution plan, distribution (redistribution) of files among storage nodes in accordance with the optimal distribution plan. Experimental evaluation of the proposed approach confirmed its high efficiency.
Authors
- Dmitry Ivantsov
- Igor Saenko (ORCID: https://orcid.org/0000-0002-9051-5272)
Institutions
- Russian Academy of Sciences (RU)
Publication Details
- Published
- 2025-03-24
- DOI
- https://doi.org/10.1109/smartindustrycon65166.2025.10986222
- Primary Topic
- Advanced Data Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Russian Science Foundation