XRISM pre-pipeline and Singularity: container-based data processing for the X-ray imaging and spectroscopy mission and high-performance computing
The X-Ray Imaging and Spectroscopy Mission (XRISM) is the seventh Japanese X-ray observatory, with development and operation that are in collaboration with universities and research institutes in Japan, the United States, and Europe, including Japan Aerospace Exploration Agency (JAXA), National Aeronautics and Space Administration (NASA), and European Space Agency. The telemetry data downlinked from the satellite are reduced to scientific products using pre-pipeline (PPL) and pipeline software running on standard Linux virtual machines (VMs) for the JAXA and NASA sides, respectively. Observation IDs (OBSIDs) identified the observations, and we had 80 and 161 OBSIDs to be reprocessed at the end of the commissioning period and performance verification and calibration period, respectively. The combination of the containerized PPL utilizing Singularity of a container platform running on JAXA’s “TOKI-RURI” high-performance computing (HPC) system and working disk images formatted to ext3 accomplished a 33× speedup in PPL tasks over our regular VM. Herein, we briefly describe the data processing in XRISM and our porting strategies for PPL in the HPC environment.
Authors
- Kotaro Fukushima (ORCID: https://orcid.org/0000-0001-8055-7113)
- Ken Ebisawa
- Satoshi Eguchi
- Y. Terada (ORCID: https://orcid.org/0000-0002-2359-1857)
- Eric D. Miller (ORCID: https://orcid.org/0000-0002-3031-2326)
- Yoshiaki Kanemaru (ORCID: https://orcid.org/0000-0002-4541-1044)
- Katsuhiro Hayashi (ORCID: https://orcid.org/0000-0001-8665-2154)
- Robert Hill (ORCID: https://orcid.org/0000-0003-1376-0300)
- Michael Loewenstein (ORCID: https://orcid.org/0000-0002-1661-4029)
- M. Tashiro (ORCID: https://orcid.org/0000-0002-5097-1257)
- H. Takahashi (ORCID: https://orcid.org/0000-0001-6314-5897)
- Yuusuke Uchida (ORCID: https://orcid.org/0000-0002-7962-4136)
- Morgan D. Waddy
- Mark Mekosh
- Nagomi Uchida (ORCID: https://orcid.org/0000-0002-5641-745X)
- Shoji Ogawa (ORCID: https://orcid.org/0009-0005-6993-3719)
- Tessei Yoshida
- Masayoshi Nobukawa
- Matthew Holland
- Tahir Yaqoob
- Joseph B. Fox
- Isabella S. Brewer
- Emily Aldoretta
Institutions
- Hiroshima University (JP)
- Kumamoto Gakuen University (JP)
- Goddard Space Flight Center (US)
- Nara University of Education (JP)
- Tokyo University of Science (JP)
- Japan Aerospace Exploration Agency (JP)
- National Aeronautics and Space Administration (US)
- Massachusetts Institute of Technology (US)
- Saitama University (JP)
Publication Details
- Journal
- Journal of Astronomical Telescopes Instruments and Systems
- Published
- 2025-08-28
- DOI
- https://doi.org/10.1117/1.jatis.11.4.042013
- Primary Topic
- Distributed and Parallel Computing Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Aeronautics and Space Administration
- Goddard Space Flight Center
- Japan Society for the Promotion of Science