Standardised formats and open-source analysis tools for the MAGIC telescopes data

Instruments for gamma-ray astronomy at Very High Energies ( E > 100 GeV ) have traditionally derived their scientific results through proprietary data and software. Data standardisation has become a prominent issue in this field both as a requirement for the dissemination of data from the next generation of gamma-ray observatories and as an effective solution to realise public data legacies of current-generation instruments. Specifications for a standardised gamma-ray data format have been proposed as a community effort and have already been successfully adopted by several instruments. We present the first production of standardised data from the Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes. We converted 166 h of observations from different sources and validated their analysis with the open-source software Gammapy . We consider six data sets representing different scientific and technical analysis cases and compare the results obtained analysing the standardised data with open-source software against those produced with the MAGIC proprietary data and software. Aiming at a systematic production of MAGIC data in this standardised format, we also present the implementation of a database-driven pipeline automatically performing the MAGIC data reduction from the calibrated down to the standardised data level. In all the cases selected for the validation, we obtain results compatible with the MAGIC proprietary software, both for the manual and for the automatic data productions. Part of the validation data set is also made publicly available, thus representing the first large public release of MAGIC data. This effort and this first data release represent a technical milestone toward the realisation of a public MAGIC data legacy. • We present the effort to produce the MAGIC telescopes data in a standardised format. • We validate the analysis of the standardised data with the open software Gammapy. • We implement a database-driven pipeline to systematically produce standardised data. • This work represents a technical milestone towards a public MAGIC Data Legacy. • Part of the validation data set is made publicly available.

Authors

Institutions

Publication Details

Journal
Journal of High Energy Astrophysics
Published
2024-10-09
DOI
https://doi.org/10.1016/j.jheap.2024.09.011
Primary Topic
Astronomical Observations and Instrumentation
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Standardised formats and open-source analysis tools for the MAGIC telescopes data

M. Linhoff, Patrick Günther, F. Leone, J. Sitarek et al.
Journal of High Energy Astrophysics
Astronomical Observations and Instrumentation
article

Standardised formats and open-source analysis tools for the MAGIC telescopes data

M. Linhoff, Patrick Günther, F. Leone, J. Sitarek, D. Sobczyńska, O. Blanch, K. Schmidt, F. Schmuckermaier, Moritz Hütten, M. Persic, M. Artero, S. Mender, J.G. Green, E. Molina, Francesco Gabriele Saturni, Alvaro Mas-Aguilar, Cosimo Nigro, C. Bigongiari, P. Temnikov, J.L Schubert, M. Mariotti, Daniel Morcuende, D. Green, J. Abhir, L. Linhoff, G. Busetto, I. Viale, U. Barres de Almeida, Sargis Gasparyan, Pouya M. Kouch, E. Bernardini, A. López-Oramas, P. Majumdar, F. Podobnik, D. Cerasole, R. Grau, J. A. Barrio, R. Walter, Stefan Fröse, A. Bautista, M. Delfino, J. Otero-Santos, I. Batković, G. Maneva, J. Jormanainen, G. D'Amico, Jelena Strišković, M. Carretero-Castrillo, E. Prandini, I. Vovk, L. Font, A. Fattorini, M. Ribó, Takayuki Yamamoto, C. Vigorito, S. Paiano, T. Njoh Ekoume, T. Kayanoki, N. Sahakyan, F. Di Pierro, B. De Lotto, J. M. Paredes, T. Terzić, Antonio Tutone, T. Aniello, E. Lyard, R. Takeishi, D. Mazin, M. Nievas Rosillo, Martin Will, V. Neustroev, C. Nanci, M. Garczarczyk, J. Delgado, A. Arbet Engels, Sofia Suutarinen, Vitalii Sliusar, Miguel Molero Gonzalez, A. Lorini, C. Wunderlich, L. Fariña, M. Doro, A. Berti, A. Babić, G. Bonnoli, L. Foffano, A. Stamerra, H. A. Mondal, D. Dominis Prester, Miguel J. A. Láinez, K. Noda, S. Lombardi, T. Schweizer, Raniere de Menezes, M. Gaug, J. Escudero, Cornelia Arcaro, Gabriella Silvestri, S. Menchiari, J. Cortina, T. Hassan, W. Rhode, K. Terauchi, S. Covino, Arnau Aguasca-Cabot, Gert Werner Kluge, D. Elsäesser, S. Loporchio, M. Manganaro, J. G. Giesbrecht Paiva, J. Besenrieder, A. Sciaccaluga, A. Cifuentes, L. Heckmann, D. Miceli, Irene Jiménez Martínez, C. Priyadarshi, J. M. Miranda, Chiara Righi, V. D'Elia, A. Okumura, P. Gliwny, Jordi Gonzàlez, J. Kushida, M. Pihet, M. Peresano, R. Carosi, L. A. Antonelli, Y. Ohtani, M. Takahashi, J. Baxter, R. Imazawa, J. Bernete, E. Bronzini, A. Campoy-Ordaz, T. Gradetzke, Y. Suda, Hiroyasu Tajima, Marcos López, S. Nozaki, M. Martínez, A.J. Castro-Tirado, N. Giglietto, R. López-Coto, A. Donini, R. J. Garcı́a López, A. Abhishek, Y. Kobayashi, A. Lamastra, G. Pirola, G. Ceribella, S. Fukami, R. Di Tria, T. Miener, J. Herrera Llorente, T. Nakamori, A. Carosi, F. Dazzi, P. Da Vela, A. Hahn, K. Mannheim, W. Bednarek, D. Paneque, J. van Scherpenberg, M. Vazquez Acosta, A. De Angelis, S. Truzzi, J. Rico, A. Moralejo, S. Ansoldi, R. Mirzoyan, M. Strzys, K. Asano, H. Kubo, G. Principe, A. Spolon, D. Strom, L. Jouvin, I. Agudo, I. Burelli, L. Di Venere, S. Abe, Y. Chai, S. Ubach, F. Longo, S. Mangano, S. Ventura, E. Lindfors, V. Vitale, F. Giordano, Y. Fukazawa, L. Nickel, D. Hadasch, P.G. Prada Moroni, T. Saito, K. Ishio, B. Machado de Oliveira Fraga, R. Paoletti, M. Makariev, V.A. Acciari, A. Biland, D. Hrupec, K. Nishijima, M. Martínez-Chicharro, J.L. Contreras, D. Dorner, M. Teshima, E. Colombo, D. Kerszberg, L. Nikolić, Ž. Bošnjak
article en

Abstract

Instruments for gamma-ray astronomy at Very High Energies ( E > 100 GeV ) have traditionally derived their scientific results through proprietary data and software. Data standardisation has become a prominent issue in this field both as a requirement for the dissemination of data from the next generation of gamma-ray observatories and as an effective solution to realise public data legacies of current-generation instruments. Specifications for a standardised gamma-ray data format have been proposed as a community effort and have already been successfully adopted by several instruments. We present the first production of standardised data from the Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes. We converted 166 h of observations from different sources and validated their analysis with the open-source software Gammapy . We consider six data sets representing different scientific and technical analysis cases and compare the results obtained analysing the standardised data with open-source software against those produced with the MAGIC proprietary data and software. Aiming at a systematic production of MAGIC data in this standardised format, we also present the implementation of a database-driven pipeline automatically performing the MAGIC data reduction from the calibrated down to the standardised data level. In all the cases selected for the validation, we obtain results compatible with the MAGIC proprietary software, both for the manual and for the automatic data productions. Part of the validation data set is also made publicly available, thus representing the first large public release of MAGIC data. This effort and this first data release represent a technical milestone toward the realisation of a public MAGIC data legacy. • We present the effort to produce the MAGIC telescopes data in a standardised format. • We validate the analysis of the standardised data with the open software Gammapy. • We implement a database-driven pipeline to systematically produce standardised data. • This work represents a technical milestone towards a public MAGIC Data Legacy. • Part of the validation data set is made publicly available.

Journal of High Energy AstrophysicsVol. 44
University of Siena (IT), Universidad Complutense de Madrid (ES), University of Udine (IT), University of Padua (IT), University of Trieste (IT), Universidad de La Laguna (ES), University of Zagreb (HR), Institute for High Energy Physics (ES), ETH Zurich (CH), Max Planck Institute for Physics (DE), Istituto Nazionale di Fisica Nucleare, Sezione di Padova (IT), International Center for Relativistic Astrophysics (IT), Centro Brasileiro de Pesquisas Físicas (BR), Instituto de Astrofísica de Canarias (ES), Instituto de Astrofísica de Andalucía (ES), Universitat de Barcelona (ES), The University of Tokyo (JP), National Institute for Astrophysics (IT)
Ministerio de Ciencia, Innovación y Universidades, Centres de Recerca de Catalunya, Fundación Carmen y Severo Ochoa, Deutsche Forschungsgemeinschaft, Ministry of Education, Culture, Sports, Science and Technology, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung, Bundesministerium für Bildung und Forschung, Generalitat de Catalunya, Conselho Nacional de Desenvolvimento Científico e Tecnológico, Max-Planck-Gesellschaft, Hrvatska Zaklada za Znanost, Ministerstwo Edukacji i Nauki, Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro, Ministério da Ciência, Tecnologia, Inovações e Comunicações, Instituto de Astrofísica de Canarias, Japan Society for the Promotion of Science, European Regional Development Fund, Agencia Estatal de Investigación, Institute for Cosmic Ray Research, University of Tokyo
Openalex Percentile: Top 81%
Astronomical Observations and Instrumentation
DOIOpen Access PDFOpenAlex
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.