Volumetric Chest CT Report Generation via State-Space Visual Prompting and Clinical-Fact Alignment
Abstract Objective: To address the memory bottlenecks of 3D sequence modeling and the factual hallucinations associated with cross-entropy optimization in automated 3D chest CT report generation. Approach: We propose an end-to-end framework that couples perception refinement with clinical-fact alignment. First, a hybrid perception module integrates spatial visual encoding with a bidirectional state-space model to capture global anatomical topology at linear computational complexity. Second, a lesion-aware visual prompting module extracts key pathological signals through cross-view synergy and adaptive residual gating. Finally, the text decoder is fine-tuned with the Group Relative Policy Optimization (GRPO) algorithm under an asymmetric composite reward, reducing its reliance on normal templates. Main results: Experiments on the CTRG-Chest-548K dataset show that the proposed method achieves competitive natural language generation performance and, more importantly, a substantial improvement in clinical accuracy. The RadGraph F1 score increases from 41.89 to 44.63 relative to the strongest baseline, indicating reduced factual hallucination. Significance: Combined with a 71% reduction in peak inference memory, these results indicate that the framework is a practical step toward deployable and clinically reliable automated CT interpretation.
Authors
- Ziyang Li (ORCID: https://orcid.org/0000-0002-0371-6341)
- Dedong Yang (ORCID: https://orcid.org/0000-0001-7950-6810)
- Jianfeng Zhang (ORCID: https://orcid.org/0009-0009-0483-8277)
- Rongtao Li (ORCID: https://orcid.org/0009-0009-3132-1169)
Institutions
- Hebei University of Technology (CN)
Publication Details
- Journal
- Physics in Medicine and Biology
- Published
- 2026-11-03
- DOI
- https://doi.org/10.1088/1361-6560/aebd60
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00