Euclid Data Release 1 (DR1). An overview of the Science Ground Segment architecture and operations

The Euclid mission is designed to address fundamental questions on the nature of dark energy and dark matter by mapping the extragalactic sky with a wide-area survey complemented by targeted deep observations. The required scientific performance places stringent demands on the Euclid Science Ground Segment (SGS), which transforms raw telemetry into calibrated, validated, and scientifically exploitable products. The SGS is a distributed system comprising the Euclid Science Operations Centre, the Science Data Centres, Instrument Operation Teams, and supporting Organisation Units, within a common architectural and procedural framework. This paper presents the SGS as implemented for Data Release 1 (DR1), describing its organisation, architecture, processing functions, and operational model. We outline the main components of the SGS common infrastructure. A key element is the Euclid Archive System (EAS), the central metadata repository based on a common data model. It comprises a Distributed Storage System, providing scalable storage of data files across the Science Data Centres; a Data Processing System used by the pipelines to register and access files and their lineage; and a Science Archive, distributing validated data products. Processing is coordinated by a common orchestration framework based on the Infrastructure Abstraction Layer, providing workflow management and resource abstraction of distributed compute clusters. Software development, integration, and deployment are supported by the Common Development Environment. We describe daily operations, calibration, and quality control, followed by the DR1 production campaign, including processing flows, validation strategy, and computational and data volumes. This infrastructure enabled Euclid DR1, involving 35 million jobs across nine Science Data Centres and 6.7 million core-hours, demonstrating robustness and scalability of the SGS.

Authors

Institutions

Publication Details

Journal
arXiv (Cornell University)
Published
2026-11-12
DOI
https://doi.org/10.48550/arxiv.2611.16480
Primary Topic
Scientific Computing and Data Management
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Euclid Data Release 1 (DR1). An overview of the Science Ground Segment architecture and operations

Pierre-Yves Chabaud, Chris Carbone, Y. Copin, F Faustini et al.
arXiv (Cornell University)
Scientific Computing and Data Management
preprint

Euclid Data Release 1 (DR1). An overview of the Science Ground Segment architecture and operations

Pierre-Yves Chabaud, Chris Carbone, Y. Copin, F Faustini, Andrea Bonchi, L. Gabarra, Christopher J. Conselice, Henk Hoekstra, A. Biviano, F. Dubath, A. Balestra, Ralf Bender, FABIO PASIAN, Frank U. Grupp, Andrea Zacchei, Rob Blake, Javier Graciá-Carpio, N. Auricchio, O. R. Williams, W. A. Holmes, H. Dole, W. G. Hartley, C. Dolding, C Colodro-Conde, A. Gregorio, A. Grazian, K. George, Cimatti A, S. Cavuoti, H Degaudenzi, G Congedo, Euclid Collaboration, P. Battaglia, E. Franceschi, F. Courbin, R. Farinelli, G. Castignani, C. Baccigalupi, G. De Lucia, G. Riccio, G. De Lucia, Federico Rizzo, V. Capobianco, M. Baldi, B. Gillis, A. Basset, S. V. H. Haugan, S. Hemmati, K. C. Chambers, E. Branchini, S. Marcin, X. Dupac, M. Castellano, M. Cropper, G. Angora, M. Melchior, N. Fourmanoit, J. Carretero, H. M. Courtois, S. Ferriol, S. Bardelli, S. Camera, T. Heuberger, S. Kruk, A. Costille, B. Altieri, M. Farina, S. Andreon, M. Frailis, S. Galeotta, M. Fumana, M. Brescia, S. Escoffier, S. Dusini, S. Farrens, X. Goudot, F. Finelli, C. Giocoli, S. Gwyn, R. Gimenez, S. Awan, S. Maurogordato, M. S. Holliman, W. Gillard, J. Hoar, A. N. Belikov, J. BENARROCH, L. Conversi, G. Libet, J. Haase, P. Franzetti, M. Ruffenach, P. Gómez-Alvarez, T. Bouvard, G. Helou, R. Giusteri, R. da Silva, H. Aussel, P. Casenove, E. A. Valentijn
preprint en

Abstract

The Euclid mission is designed to address fundamental questions on the nature of dark energy and dark matter by mapping the extragalactic sky with a wide-area survey complemented by targeted deep observations. The required scientific performance places stringent demands on the Euclid Science Ground Segment (SGS), which transforms raw telemetry into calibrated, validated, and scientifically exploitable products. The SGS is a distributed system comprising the Euclid Science Operations Centre, the Science Data Centres, Instrument Operation Teams, and supporting Organisation Units, within a common architectural and procedural framework. This paper presents the SGS as implemented for Data Release 1 (DR1), describing its organisation, architecture, processing functions, and operational model. We outline the main components of the SGS common infrastructure. A key element is the Euclid Archive System (EAS), the central metadata repository based on a common data model. It comprises a Distributed Storage System, providing scalable storage of data files across the Science Data Centres; a Data Processing System used by the pipelines to register and access files and their lineage; and a Science Archive, distributing validated data products. Processing is coordinated by a common orchestration framework based on the Infrastructure Abstraction Layer, providing workflow management and resource abstraction of distributed compute clusters. Software development, integration, and deployment are supported by the Common Development Environment. We describe daily operations, calibration, and quality control, followed by the DR1 production campaign, including processing flows, validation strategy, and computational and data volumes. This infrastructure enabled Euclid DR1, involving 35 million jobs across nine Science Data Centres and 6.7 million core-hours, demonstrating robustness and scalability of the SGS.

arXiv (Cornell University)
Université Claude Bernard Lyon 1 (FR), University of Geneva (CH), University of Hawaiʻi at Mānoa (US), Institució Catalana de Recerca i Estudis Avançats (ES), Leiden University (NL), California Institute of Technology (US), Herzberg Institute of Astrophysics (CA), Centre National de la Recherche Scientifique (FR), Institute of Space Sciences (ES), University of Hawaii System (US), Jet Propulsion Laboratory (US), Scuola Internazionale Superiore di Studi Avanzati (IT), University of Trieste (IT), University of Groningen (NL), University of Oslo (NO), University of Ferrara (IT), Université Côte d'Azur (FR), Université Paris Cité (FR), Aix-Marseille Université (FR), Commissariat à l'Énergie Atomique et aux Énergies Alternatives (FR), Université Paris-Saclay (FR), Centre National d'Études Spatiales (FR), Astronomical Observatory of Rome (IT), Agenzia Spaziale Italiana (IT), Trieste Astronomical Observatory (IT), Astronomical Observatory of Capodimonte (IT), European Space Agency (FR), Brera Astronomical Observatory (IT), University of Manchester (GB), FHNW University of Applied Sciences and Arts Northwestern Switzerland (CH), University of Oxford (GB), Astrophysique, Instrumentation et Modélisation (FR), Max Planck Institute for Extraterrestrial Physics (DE), European Space Astronomy Centre (ES), Centre de physique des particules de Marseille (FR), Istituto Nazionale di Fisica Nucleare, Sezione di Torino (IT), Institute for Space Astrophysics and Planetology (IT), Institut d'Astrophysique Spatiale (FR), Istituto Nazionale di Fisica Nucleare, Sezione di Padova (IT), Osservatorio Astrofisico di Torino (IT), Royal Observatory (GB), Istituto Nazionale di Fisica Nucleare, Sezione di Napoli (IT), Lagrange Laboratory (FR), Istituto Nazionale di Fisica Nucleare, Sezione di Genova (IT), Observatoire de la Côte d’Azur (FR), ATG Europe (Netherlands) (NL), Instituto de Astrofísica de Canarias (ES), Institut National de Physique Nucléaire et de Physique des Particules (FR), Thales (France) (FR), Istituto Nazionale di Fisica Nucleare, Sezione di Bologna (IT), Port d'Informació Científica (ES), Istituto Nazionale di Fisica Nucleare, Sezione di Trieste (IT), Institute for Fundamental Physics of the Universe (IT), Osservatorio Astronomico di Padova (IT), National Research Council Canada (CA), European Space Research Institute (IT), Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (ES), Infrared Processing and Analysis Center (US), Osservatorio di Astrofisica e Scienza dello Spazio (IT), Institut de Physique des 2 Infinis de Lyon (FR), Leiden Observatory (NL), Institut de Ciències del Cosmos (ES), University College London (GB), University of Turin (IT), University of Naples Federico II (IT), Ludwig-Maximilians-Universität München (DE), University of Genoa (IT), National Institute for Astrophysics (IT), University of Bologna (IT), University of Edinburgh (GB)
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon