Quality Control of Geostationary Lightning Mapper Observations for Tropical Cyclone Applications

Abstract The Geostationary Lightning Mapper (GLM) has been providing unprecedented observations of total lightning since becoming operational in 2017. The potential for GLM observations to be used for forecasting and analyzing tropical cyclone (TC) structure and intensity has been complicated by inconsistencies in the GLM data from a number of artifacts. The algorithm that processes raw GLM data has improved with time; however, the need for a consistent long-term dataset has motivated the development of quality control (QC) techniques to help remove clear artifacts such as blooming events, spurious false lightning, ‘bar’ effects, and sun glint. Simple QC methods are applied that include scaled maximum energy thresholds and minima in the variance of lightning group area and group energy. QC and anomaly detection methods based on machine learning (ML) are also explored. Each QC method is successfully able to remove artifacts in the GLM observations while maintaining the fidelity of the GLM observations within TCs. As the GLM processing algorithm has improved with time, the amount of QC flagged lightning within 100 km of Atlantic TCs is reduced, from 70% during 2017, to 10% in 2018, to 2% during 2021. These QC methods are relevant to the design of ML-based forecasting techniques which could pick up on artifacts rather than the signal of interest in TCs if QC wasn’t applied beforehand.