A novel method for evaluating earthquake forecast model performance and its implications for refining seismic likelihood model

SUMMARY Utilizing statistical tests to evaluate earthquake forecasting models is crucial to improve forecasting strategies for seismic hazard assessment. We develop a novel evaluation method for alarm-based earthquake forecast, taking into account the magnitude of seismic energy and the impact area of earthquakes, instead of using solely seismic event number and epicentre locations in conventional approaches. First, we derive a scale law of Seismic Area by statistically analysing coseismal maps of past M ≥ 7.0 earthquakes. Second, we proportionally allocate Seismic Moment to surrounding cells based on corresponding seismic area within each cell (SASM-test). Compared to the Molchan test which is conventionally applied for models that forecast the epicentre location, our proposed SASM-test can be applied to the evaluation of forecasting models that focus on the whole earthquake rupture (source area). Third, we apply the SASM-test method to the time-independent probabilistic earthquake forecasting model for the southeastern Tibetan Plateau (RELM-TibetSE) and compare it with other evaluation methods. The retrospective testing shows that the SASM-test demonstrate relatively higher sensitivity, enabling to detect subtle differences between similar models that conventional methods may overlook. Additionally, retrospective test results indicate that: (i) Earthquake forecasting models using Global Navigation Satellite System (GNSS) data performed better in forecasting the ‘source area’ than the ‘epicentre location’; (ii) forecasting models based on principal strain rate outperformed the models based on maximum shear strain rate in forecasting both the epicentre location and the source area and (iii) incorporating spatially varying seismogenic layer thickness and rigidity into seismic forecasting models could improve their ability to forecast the ‘source area’ compared to using uniform seismogenic layer properties. The newly proposed SASM-test method can provide a more sensitive and comprehensive approach for the evaluation of earthquake forecasting models, contributing to the refinement of seismic hazard assessments.