HAT: Achieving Comprehensive Inpainting of Lunar Spectral Imagery
Lunar spectral imagery plays an indispensable role in the analysis of geomorphological features and the study of mineral distribution. However, although the Selenological and Engineering Explorer (SELENE) mission of the Japan Aerospace Exploration Agency (JAXA) provides high-resolution lunar spectral imagery, the limited scan width of its imaging instrument leads to substantial data voids, significantly constraining the scientific utility of these data.To address this challenge, we propose an innovative image inpainting model, Hole-aware Transformer (HAT), which is designed to effectively capture long-range feature dependencies and deeply understand image contextual information. Moreover, with its unique Holeaware Multi-Head Attention mechanism (HAMA), the model can adaptively handle data voids of various sizes and shapes, avoid interactions with invalid feature(i.e., those within data missing regions), and hence generate completed images that are more visually and semantically realistic. Through comparative experiments with existing mainstream methods, our HAT model has demonstrated outstanding repair performance. Finally, based on the repair results of the HAT model, we have created a complete lunar spectral image for the first time, providing a new perspective and tool for lunar science research.
Authors
- Dingruibo Miao (ORCID: https://orcid.org/0000-0003-0561-6915)
- Jean‐Pierre Barriot (ORCID: https://orcid.org/0000-0002-2112-9685)
- Jianguo Yan (ORCID: https://orcid.org/0000-0003-2612-4776)
- Depei Gu (ORCID: https://orcid.org/0000-0002-0971-7222)
- Zhigang Tu (ORCID: https://orcid.org/0000-0001-5003-2260)
Institutions
- State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing (CN)
- University of French Polynesia (PF)
Publication Details
- Journal
- IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jstars.2025.3578835
- Primary Topic
- Generative Adversarial Networks and Image Synthesis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China