Self-Attentive Deep Fusion Framework with Transformer-Based Semantics for Emergency Head CT Reporting

Head Computed Tomography (CT) scans are com-monly used in emergency departments to identify neurologi-cal conditions. However, manual radiology reporting is time-consuming and subject to cognitive biases, especially under time constraints. This work presents a self-attentive deep fusion frame-work for automatic radiology reporting tailored to emergency head CT imaging. Building on our previously developed system, the proposed model incorporates clinically validated preprocessing for head CTs, a multimodal neural network refined through fine-grained regularization, and intra-sequence self-attention to enhance context modeling. Eight uniformly resampled slices per scan are used as input, and each report section is generated as an independent caption and semantically ranked using a Transformer-based evaluator based on perplexity. The best pre-dictions are concatenated to form ordered reports. The model was trained and evaluated on a dataset of real-world emergency head CTs using ROUGE-L and METEOR as quantitative met-rics. The proposed system achieved improvements of +6% in ROUGE-L and +3% in METEOR compared to the reference architecture, and +4% and +2% compared to the same model without self-attention. These results confirm the contribution of self-attention for improving contextual coherence and report quality. The framework remains lightweight and scalable, making it suitable for time-sensitive environments. Future work will explore condition-specific modeling and vision-language model integration.