Team XSZ at BioLaySumm2025: Section-Wise Summarization, Retrieval-Augmented LLM, and Reinforcement Learning Fine-Tuning for Lay Summaries
We present a multi-stage pipeline for BioLay-Summ 2025 Subtask 1.1 that improves readability, relevance, and factuality.First, we select the top-5 relevant sections and generate summaries with BioBART.Next, we retrieve a Kshot demonstration using BGE embeddings to prompt Llama 3 8B and fine-tune it with LoRA.We then merge section summaries via a second BioBART pass.Finally, we apply reinforcement learning (PPO and GRPO) with a composite reward combining factuality (AlignScore, SummaC), relevance (ROUGE-L, BERTScore), and readability (LENS, FKGL, DCRS, CLI).On PLOS and eLife validation sets, our pipeline reduces DCRS from 9.23 to 8.56 and CLI from 12.98 to 12.65, and boosts AlignScore from 0.722 to 0.862, demonstrating balanced gains in lay-summary quality.
Authors
- Pengcheng Xu (ORCID: https://orcid.org/0000-0001-8651-208X)
- Jieli Zhou (ORCID: https://orcid.org/0000-0003-3555-5308)
- Hongyi Xin (ORCID: https://orcid.org/0000-0003-2864-7386)
- Sicheng Shen
Institutions
- Shanghai Jiao Tong University (CN)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.bionlp-share.33
- Citations
- 1
- Primary Topic
- Biomedical Text Mining and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 0.81