Lumen: A Deep Reinforcement Learning Assisted File Placement Manager

With the rapid growth of data volume, hybrid storage file systems are always adopted to meet increasing demands for performance, capacity, and cost efficiency. These systems manage multiple storage devices and dynamically adjust file locations to optimize resource usage. In this paper, we present Lumen, a reinforcement learning-assisted file placement manager. Lumen uses online reinforcement learning to periodically adjust file placement according to system status and application's access patterns. To balance device utilization in the file creation phase, Lumen also introduces a device-load aware file allocation strategy. Evaluation results show that Lumen achieves up to 2.26x bandwidth improvement over spfs, a state-of-the-art hybrid storage file system.

Authors

Institutions

Publication Details

Published
2025-04-24
DOI
https://doi.org/10.1109/icccbda64898.2025.11030431
Primary Topic
Business Process Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Lumen: A Deep Reinforcement Learning Assisted File Placement Manager

Jiaqing Xu, Gen Zhang, Zhenlong Song, Jiawei Gao
Business Process Modeling and Analysis
article

Lumen: A Deep Reinforcement Learning Assisted File Placement Manager

Jiaqing Xu, Gen Zhang, Zhenlong Song, Jiawei Gao
article en

Abstract

With the rapid growth of data volume, hybrid storage file systems are always adopted to meet increasing demands for performance, capacity, and cost efficiency. These systems manage multiple storage devices and dynamically adjust file locations to optimize resource usage. In this paper, we present Lumen, a reinforcement learning-assisted file placement manager. Lumen uses online reinforcement learning to periodically adjust file placement according to system status and application's access patterns. To balance device utilization in the file creation phase, Lumen also introduces a device-load aware file allocation strategy. Evaluation results show that Lumen achieves up to 2.26x bandwidth improvement over spfs, a state-of-the-art hybrid storage file system.

National University of Defense Technology (CN)
Openalex Percentile: Top 76%
Business Process Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Lumen: A Deep Reinforcement Learning Assisted File Placement Manager — Jiaqing Xu, Gen Zhang, et al. · (2025) | TGRS Research Map | TGRS