Libra: Leveraging Temporal Images for Biomedical Radiology Analysis
Radiology report generation (RRG) requires advanced medical image analysis, effective temporal reasoning, and accurate text generation.While multimodal large language models (MLLMs) align with pre-trained vision encoders to enhance visual-language understanding, most existing methods rely on singleimage analysis or rule-based heuristics to process multiple images, failing to fully leverage temporal information in multi-modal medical datasets.In this paper, we introduce Libra, a temporal-aware MLLM tailored for chest X-ray report generation.Libra combines a radiologyspecific image encoder with a novel Temporal Alignment Connector (TAC), designed to accurately capture and integrate temporal differences between paired current and prior images.Extensive experiments on the MIMIC-CXR dataset demonstrate that Libra establishes a new state-of-the-art benchmark among similarly scaled MLLMs, setting new standards in both clinical relevance and lexical accuracy.
Authors
- Zaiqiao Meng (ORCID: https://orcid.org/0000-0001-5374-0318)
- Edmond S. L. Ho (ORCID: https://orcid.org/0000-0001-5862-106X)
- Xi Zhang (ORCID: https://orcid.org/0000-0001-7907-6363)
- Jake Lever
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.findings-acl.888
- Citations
- 2
- Primary Topic
- AI in cancer detection
- Type
- article
- Field-Weighted Citation Impact
- 4.96