Lumen: A Deep Reinforcement Learning Assisted File Placement Manager
With the rapid growth of data volume, hybrid storage file systems are always adopted to meet increasing demands for performance, capacity, and cost efficiency. These systems manage multiple storage devices and dynamically adjust file locations to optimize resource usage. In this paper, we present Lumen, a reinforcement learning-assisted file placement manager. Lumen uses online reinforcement learning to periodically adjust file placement according to system status and application's access patterns. To balance device utilization in the file creation phase, Lumen also introduces a device-load aware file allocation strategy. Evaluation results show that Lumen achieves up to 2.26x bandwidth improvement over spfs, a state-of-the-art hybrid storage file system.
Authors
- Jiaqing Xu (ORCID: https://orcid.org/0000-0002-2321-4031)
- Gen Zhang (ORCID: https://orcid.org/0000-0002-5314-3019)
- Zhenlong Song (ORCID: https://orcid.org/0000-0002-4085-8437)
- Jiawei Gao (ORCID: https://orcid.org/0000-0002-3759-2367)
Institutions
- National University of Defense Technology (CN)
Publication Details
- Published
- 2025-04-24
- DOI
- https://doi.org/10.1109/icccbda64898.2025.11030431
- Primary Topic
- Business Process Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00