Adding layers of information to scRNA-seq data using pre-trained language models

Pre-trained language models promise to enrich single-cell analyses with contextual information from large biomedical text corpora, but it remains unclear how to optimally align this knowledge with quantitative single-cell RNA sequencing (scRNA-seq) data. To address this, we construct text-based training datasets from both scRNA-seq data and biomedical literature targeted to the experimental setting at hand. We then fine-tune lightweight encoder-only biomedical language models to learn a shared, literature-enriched representation. Controlled evaluations across immune and developmental datasets show that this representation preserves cell identity while adding robust and interpretable contextual layers of functional, disease-associated, and developmental information to single-cell analysis workflows.

Authors

Institutions

Publication Details

Journal
Genome biology
Published
2026-11-19
DOI
https://doi.org/10.1186/s13059-026-04353-y
Citations
1
Primary Topic
Single-cell and spatial transcriptomics
Type
article
Field-Weighted Citation Impact
1.12

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Adding layers of information to scRNA-seq data using pre-trained language models

Jasper Menger, Harald Binder, Tanja Vogel, Maren Hackenberg et al.
1 citations
Genome biology
Single-cell and spatial transcriptomics
1.12
article

Adding layers of information to scRNA-seq data using pre-trained language models

Jasper Menger, Harald Binder, Tanja Vogel, Maren Hackenberg, Johan Rollin, Sonia Maria Krissmer
article en
1 citations

Abstract

Pre-trained language models promise to enrich single-cell analyses with contextual information from large biomedical text corpora, but it remains unclear how to optimally align this knowledge with quantitative single-cell RNA sequencing (scRNA-seq) data. To address this, we construct text-based training datasets from both scRNA-seq data and biomedical literature targeted to the experimental setting at hand. We then fine-tune lightweight encoder-only biomedical language models to learn a shared, literature-enriched representation. Controlled evaluations across immune and developmental datasets show that this representation preserves cell identity while adding robust and interpretable contextual layers of functional, disease-associated, and developmental information to single-cell analysis workflows.

Genome biology
University of Freiburg (DE), University Medical Center Freiburg (DE), European Molecular Biology Laboratory (DE), European Molecular Biology Laboratory (DE)
Deutsche Forschungsgemeinschaft
Openalex Percentile: Top 31%
Single-cell and spatial transcriptomics
1.12
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon