S1509 Artificial Intelligence Assessment of Linear Endoscope Velocity Improves Standardization of Continuous Assessment of Endoscopic Severity in Ulcerative Colitis

Introduction: Artificial Intelligence assessment of Endoscopic Severity and Extent (AI-ESe) is a deep learning approach to continuous assessment of inflammation on endoscopy in ulcerative colitis (UC). Initial approaches assess inflammation via uniform temporal sampling over the procedure video. However, stalling - defined as time during withdrawal where the endoscope pauses in the longitudinal direction, not including panning or rotation - can lead to oversampling of the same mucosal surface. We developed an automated system using deep learning to measure endoscope linear velocity and applied thresholding to detect stalling, aiming to improve sampling uniformity in AI-ESe assessments. Methods: We evaluated our ability to detect stalling on endoscopic video recordings from the Phase 3 induction trial for mirikizumab in UC (NCT03518086) and routine practice. Five experienced human reviewers were trained to manually identify stalling on withdrawal. To assess human variability, 10 videos were independently reviewed by all 5 reviewers. An additional 78 videos formed a holdout test set, with stalling labeled by one reviewer and quality-checked by a second. Error was measured to compare the difference in endoscope position between pairs of human reviewers, between human review and the model, and between human review and the null method based on uniform temporal sampling. Mean absolute error (MAE) was computed from error over each video. Confidence intervals (CIs) were computed by bootstrap resampling by videos. Results: Comparison of pairs of human reviewers in assessing stalling yielded an MAE in endoscope position of 17 seconds (95% CI 9-29 seconds). Use of the velocity model to assess stalling compared to human assessment showed a comparable MAE of 22 seconds (95% CI 17-27 seconds). In contrast, uniform temporal sampling had roughly double the MAE compared to stalling adjustment (40 seconds, 95% CI 32-49 seconds), primarily due to overcounting of the same mucosal surface during stalling. Conclusion: We present a novel deep learning approach to measure the velocity of the endoscope and apply this model to detect stalling during procedure recordings in UC. These results demonstrate that adjusting for stalling improves the consistency of spatial sampling, and that our model can effectively identify these periods at a human level of accuracy. This approach can help standardize more granular AI-based endoscopic scoring in UC by ensuring uniform assessment of the mucosal surface.

Authors

Publication Details

Journal
The American Journal of Gastroenterology
Published
2025-10-01
DOI
https://doi.org/10.14309/01.ajg.0001133496.41347.74
Primary Topic
Colorectal Cancer Screening and Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

S1509 Artificial Intelligence Assessment of Linear Endoscope Velocity Improves Standardization of Continuous Assessment of Endoscopic Severity in Ulcerative Colitis

Mohammad Haft‐Javaherian, Josh Lehrer, Klaus Gottlieb, David T. Rubin et al.
The American Journal of Gastroenterology
Colorectal Cancer Screening and Detection
article

S1509 Artificial Intelligence Assessment of Linear Endoscope Velocity Improves Standardization of Continuous Assessment of Endoscopic Severity in Ulcerative Colitis

Mohammad Haft‐Javaherian, Josh Lehrer, Klaus Gottlieb, David T. Rubin, Pavel Brodskiy, Daniel Colucci, Darren Thomason
article en

Abstract

Introduction: Artificial Intelligence assessment of Endoscopic Severity and Extent (AI-ESe) is a deep learning approach to continuous assessment of inflammation on endoscopy in ulcerative colitis (UC). Initial approaches assess inflammation via uniform temporal sampling over the procedure video. However, stalling - defined as time during withdrawal where the endoscope pauses in the longitudinal direction, not including panning or rotation - can lead to oversampling of the same mucosal surface. We developed an automated system using deep learning to measure endoscope linear velocity and applied thresholding to detect stalling, aiming to improve sampling uniformity in AI-ESe assessments. Methods: We evaluated our ability to detect stalling on endoscopic video recordings from the Phase 3 induction trial for mirikizumab in UC (NCT03518086) and routine practice. Five experienced human reviewers were trained to manually identify stalling on withdrawal. To assess human variability, 10 videos were independently reviewed by all 5 reviewers. An additional 78 videos formed a holdout test set, with stalling labeled by one reviewer and quality-checked by a second. Error was measured to compare the difference in endoscope position between pairs of human reviewers, between human review and the model, and between human review and the null method based on uniform temporal sampling. Mean absolute error (MAE) was computed from error over each video. Confidence intervals (CIs) were computed by bootstrap resampling by videos. Results: Comparison of pairs of human reviewers in assessing stalling yielded an MAE in endoscope position of 17 seconds (95% CI 9-29 seconds). Use of the velocity model to assess stalling compared to human assessment showed a comparable MAE of 22 seconds (95% CI 17-27 seconds). In contrast, uniform temporal sampling had roughly double the MAE compared to stalling adjustment (40 seconds, 95% CI 32-49 seconds), primarily due to overcounting of the same mucosal surface during stalling. Conclusion: We present a novel deep learning approach to measure the velocity of the endoscope and apply this model to detect stalling during procedure recordings in UC. These results demonstrate that adjusting for stalling improves the consistency of spatial sampling, and that our model can effectively identify these periods at a human level of accuracy. This approach can help standardize more granular AI-based endoscopic scoring in UC by ensuring uniform assessment of the mucosal surface.

The American Journal of GastroenterologyVol. 120(10S2)
Openalex Percentile: Top 45%
Colorectal Cancer Screening and Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.