Volumetric Chest CT Report Generation via State-Space Visual Prompting and Clinical-Fact Alignment

Abstract Objective: To address the memory bottlenecks of 3D sequence modeling and the factual hallucinations associated with cross-entropy optimization in automated 3D chest CT report generation. Approach: We propose an end-to-end framework that couples perception refinement with clinical-fact alignment. First, a hybrid perception module integrates spatial visual encoding with a bidirectional state-space model to capture global anatomical topology at linear computational complexity. Second, a lesion-aware visual prompting module extracts key pathological signals through cross-view synergy and adaptive residual gating. Finally, the text decoder is fine-tuned with the Group Relative Policy Optimization (GRPO) algorithm under an asymmetric composite reward, reducing its reliance on normal templates. Main results: Experiments on the CTRG-Chest-548K dataset show that the proposed method achieves competitive natural language generation performance and, more importantly, a substantial improvement in clinical accuracy. The RadGraph F1 score increases from 41.89 to 44.63 relative to the strongest baseline, indicating reduced factual hallucination. Significance: Combined with a 71% reduction in peak inference memory, these results indicate that the framework is a practical step toward deployable and clinically reliable automated CT interpretation.

Authors

Institutions

Publication Details

Journal
Physics in Medicine and Biology
Published
2026-11-03
DOI
https://doi.org/10.1088/1361-6560/aebd60
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Volumetric Chest CT Report Generation via State-Space Visual Prompting and Clinical-Fact Alignment

Ziyang Li, Dedong Yang, Jianfeng Zhang, Rongtao Li
Physics in Medicine and Biology
Multimodal Machine Learning Applications
article

Volumetric Chest CT Report Generation via State-Space Visual Prompting and Clinical-Fact Alignment

Ziyang Li, Dedong Yang, Jianfeng Zhang, Rongtao Li
article en

Abstract

Abstract Objective: To address the memory bottlenecks of 3D sequence modeling and the factual hallucinations associated with cross-entropy optimization in automated 3D chest CT report generation. Approach: We propose an end-to-end framework that couples perception refinement with clinical-fact alignment. First, a hybrid perception module integrates spatial visual encoding with a bidirectional state-space model to capture global anatomical topology at linear computational complexity. Second, a lesion-aware visual prompting module extracts key pathological signals through cross-view synergy and adaptive residual gating. Finally, the text decoder is fine-tuned with the Group Relative Policy Optimization (GRPO) algorithm under an asymmetric composite reward, reducing its reliance on normal templates. Main results: Experiments on the CTRG-Chest-548K dataset show that the proposed method achieves competitive natural language generation performance and, more importantly, a substantial improvement in clinical accuracy. The RadGraph F1 score increases from 41.89 to 44.63 relative to the strongest baseline, indicating reduced factual hallucination. Significance: Combined with a 71% reduction in peak inference memory, these results indicate that the framework is a practical step toward deployable and clinically reliable automated CT interpretation.

Physics in Medicine and Biology
Hebei University of Technology (CN)
Openalex Percentile: Top 19%
Multimodal Machine Learning Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon