Frequency-Domain Evaluation and Estimation of Semi-Markov Disease Natural History Models

Introduction: Natural history models must often be estimated from data that do not directly capture disease transitions. Semi-Markov processes let the risk of progression depend on the time spent in a health state, which Markov models need extra states to represent. Their limitation is computational: discretizing time introduces approximation error, and simulating individuals introduces Monte Carlo error and a non-differentiable calibration objective. Methods: We show that the model-implied prevalence, incidence and cause-specific mortality of a continuous-time semi-Markov model satisfy convolution equations that become a small linear system when Laplace-transformed. Solving it on a grid of complex frequencies and inverting with an accelerated Fourier series returns the targets without a time grid or Monte Carlo error, and yields exact first- and second-order derivatives for one additional linear solve each. These support Newton-type maximum likelihood estimation, gradient-informed Bayesian sampling, and local identifiability diagnostics. We apply our open-source implementation to a urinary bladder cancer model calibrated to SEER incidence and mortality by age and stage. Results: The method reproduced an independent implementation to within its accuracy (maximum relative difference 8x10 -6 ) and evaluated all targets, their gradient, and their Hessian in 1.3, 2.5, and 9.1 milliseconds; a one-year-cycle cohort approximation deviated by up to 42% and a two-million-person microsimulation by up to 811%. Maximum likelihood and Bayesian estimates agreed, and second-order information showed that the aggregate targets constrain where individuals go from preclinical states far better than how long they stay. Early-stage incidence and mortality showed systematic misfit across age. Conclusions: The framework supplies existing calibration algorithms with fast, exact model evaluations and derivatives for models whose transition hazards depend on time in state rather than on age.

Authors

Institutions

Publication Details

Journal
medRxiv
Published
2026-10-28
DOI
https://doi.org/10.64898/2026.10.23.26366343
Primary Topic
Statistical Methods in Epidemiology
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Frequency-Domain Evaluation and Estimation of Semi-Markov Disease Natural History Models

Jeremy D. Goldhaber‐Fiebert, Fernando Alarid‐Escudero, Felipe Subiabre
1 links
medRxiv
Statistical Methods in Epidemiology
preprint

Frequency-Domain Evaluation and Estimation of Semi-Markov Disease Natural History Models

Jeremy D. Goldhaber‐Fiebert, Fernando Alarid‐Escudero, Felipe Subiabre
preprint en

Abstract

Introduction: Natural history models must often be estimated from data that do not directly capture disease transitions. Semi-Markov processes let the risk of progression depend on the time spent in a health state, which Markov models need extra states to represent. Their limitation is computational: discretizing time introduces approximation error, and simulating individuals introduces Monte Carlo error and a non-differentiable calibration objective. Methods: We show that the model-implied prevalence, incidence and cause-specific mortality of a continuous-time semi-Markov model satisfy convolution equations that become a small linear system when Laplace-transformed. Solving it on a grid of complex frequencies and inverting with an accelerated Fourier series returns the targets without a time grid or Monte Carlo error, and yields exact first- and second-order derivatives for one additional linear solve each. These support Newton-type maximum likelihood estimation, gradient-informed Bayesian sampling, and local identifiability diagnostics. We apply our open-source implementation to a urinary bladder cancer model calibrated to SEER incidence and mortality by age and stage. Results: The method reproduced an independent implementation to within its accuracy (maximum relative difference 8x10 -6 ) and evaluated all targets, their gradient, and their Hessian in 1.3, 2.5, and 9.1 milliseconds; a one-year-cycle cohort approximation deviated by up to 42% and a two-million-person microsimulation by up to 811%. Maximum likelihood and Bayesian estimates agreed, and second-order information showed that the aggregate targets constrain where individuals go from preclinical states far better than how long they stay. Early-stage incidence and mortality showed systematic misfit across age. Conclusions: The framework supplies existing calibration algorithms with fast, exact model evaluations and derivatives for models whose transition hazards depend on time in state rather than on age.

medRxiv
University of Chile (CL), Stanford University (US)
National Institutes of Health, National Institute on Drug Abuse, National Cancer Institute
Good health and well-being
Statistical Methods in Epidemiology
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon