Energy Efficiency in Cloud-Based Big Data Processing for Earth Observation: Current Approaches and Future Directions

The growing concern over the energy costs and carbon footprint of big data processing has sparked significant attention and research in recent years. This focus has largely been driven by the computational intensity of large-language models (LLMs), which are predominantly trained and deployed on cloud platforms. In contrast, despite the substantial data volumes and complex computational demands of Earth Observation (EO) data, energy efficiency in this domain remains underexplored. EO is characterized by an increasing complexity and data volume due to the growing number of satellite missions and the need for multi-scales analysis. This paper investigates the state-of-the-art approaches to energy efficiency in big data processing within the EO domain (EOBD), identifying key challenges and proposing strategic improvements. We begin by outlining the current landscape of big data services in EO, including the prevalent use of cloud computing. We then analyze the unique energy efficiency challenges posed by EO data processing on cloud platforms. This is followed by an examination of common strategies employed to enhance energy efficiency in more widely studied big data environments. Through a literature studies of major EO data processing platforms, we identify significant gaps in energy efficiency practices. Our findings indicate that current EOBD systems often prioritize performance over energy efficiency, leading to unnecessary resource consumption and increased carbon emissions. Finally, we propose potential avenues for future research, including the development of benchmarking frameworks and energy measurement toolkits. We also suggest optimization techniques for infrastructure orchestration and task assignment within distributed cloud-based processing frameworks. These proposed approaches aim to foster more sustainable practices in EOBD, potentially reducing energy consumption and environmental impact while maintaining processing capabilities.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-11-12
DOI
https://doi.org/10.5281/zenodo.16266727
Primary Topic
Big Data and Digital Economy
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Energy Efficiency in Cloud-Based Big Data Processing for Earth Observation: Current Approaches and Future Directions

Zenodo (CERN European Organization for Nuclear Research)
Big Data and Digital Economy
article

Energy Efficiency in Cloud-Based Big Data Processing for Earth Observation: Current Approaches and Future Directions

article en

Abstract

The growing concern over the energy costs and carbon footprint of big data processing has sparked significant attention and research in recent years. This focus has largely been driven by the computational intensity of large-language models (LLMs), which are predominantly trained and deployed on cloud platforms. In contrast, despite the substantial data volumes and complex computational demands of Earth Observation (EO) data, energy efficiency in this domain remains underexplored. EO is characterized by an increasing complexity and data volume due to the growing number of satellite missions and the need for multi-scales analysis. This paper investigates the state-of-the-art approaches to energy efficiency in big data processing within the EO domain (EOBD), identifying key challenges and proposing strategic improvements. We begin by outlining the current landscape of big data services in EO, including the prevalent use of cloud computing. We then analyze the unique energy efficiency challenges posed by EO data processing on cloud platforms. This is followed by an examination of common strategies employed to enhance energy efficiency in more widely studied big data environments. Through a literature studies of major EO data processing platforms, we identify significant gaps in energy efficiency practices. Our findings indicate that current EOBD systems often prioritize performance over energy efficiency, leading to unnecessary resource consumption and increased carbon emissions. Finally, we propose potential avenues for future research, including the development of benchmarking frameworks and energy measurement toolkits. We also suggest optimization techniques for infrastructure orchestration and task assignment within distributed cloud-based processing frameworks. These proposed approaches aim to foster more sustainable practices in EOBD, potentially reducing energy consumption and environmental impact while maintaining processing capabilities.

Zenodo (CERN European Organization for Nuclear Research)
University of Twente (NL)
Openalex Percentile: Top 37%
Big Data and Digital Economy
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Energy Efficiency in Cloud-Based Big Data Processing for Earth Observation: Current Approaches and Future Directions · Zenodo (CERN European Organization for Nuclear Research) (2024) | TGRS Research Map | TGRS