Fast Raster Image Data Processing with Memory Cache Optimization
With the rapid advancement of satellite remote sensing technology, large-scale high-resolution raster imagery data has become a critical backbone for Geographic Information Systems (GIS), environmental monitoring, disaster early warning, and related fields. However, the continuous explosive growth of data volume and increasing demands for high real-time processing capabilities have highlighted significant performance and flexibility limitations in traditional storage solutions. To address these challenges, this study proposes an innovative distributed raster image processing framework optimized by memory caching, which integrates core modules such as cache management, memory virtualization, data persistence, and intelligent scheduling. By deeply integrating server memory resources with distributed computing architectures, the framework significantly enhances image data processing efficiency while achieving dynamic load balancing and multi-node collaborative optimization. Experimental results demonstrate that the proposed method substantially outperforms traditional disk-based solutions in terms of data throughput and task response speed, with an average improvement of 12% to 20% in processing efficiency. In addition, the framework design fully considers data security and persistence requirements, providing a systematic technical solution and practical foundation for high-real-time remote sensing image applications.
Authors
- Xuehua Chen
- Chunyan Song
- Yu Xiao
- Decheng Wang (ORCID: https://orcid.org/0000-0003-4424-1589)
Institutions
- Chinese Academy of Sciences (CN)
- Institute of Software (CN)
- China Telecom (China) (CN)
- State Key Laboratory of Remote Sensing Science (CN)
Publication Details
- Published
- 2025-03-14
- DOI
- https://doi.org/10.1145/3746709.3746710
- Primary Topic
- CCD and CMOS Imaging Sensors
- Type
- article
- Field-Weighted Citation Impact
- 0.00