Combining diffusion and transformer models for enhanced promoter synthesis and strength prediction in deep learning

We demonstrated that diffusion models are superior in accomplishing the promoter synthesis task compared to other state-of-the-art deep learning models. The effectiveness of our method was validated using data sets of <i>Escherichia coli</i> and cyanobacteria promoters, showing more stable and prompt convergence and more natural-like promoters than the variational autoencoder model. We extracted sequence information, dimer information, and position information from promoters and combined them with a transformer model to predict promoter strength. Our prediction results were more accurate than those obtained with a convolutional neural network model. Our <i>in silico</i> experiments systematically introduced mutations in promoter sequences and explored their contribution to promoter strength, highlighting the depth of learning in our model.

Authors

Institutions

Publication Details

Journal
mSystems
Published
2025-03-19
DOI
https://doi.org/10.1128/msystems.00183-25
Citations
5
Primary Topic
Genomics and Phylogenetic Studies
Type
article
Field-Weighted Citation Impact
4.03

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Combining diffusion and transformer models for enhanced promoter synthesis and strength prediction in deep learning

Xin Lei, Quhuan Li, Wei Xiong, Ce Liang et al.
5 citations
mSystems
Genomics and Phylogenetic Studies
4.03
article

Combining diffusion and transformer models for enhanced promoter synthesis and strength prediction in deep learning

Xin Lei, Quhuan Li, Wei Xiong, Ce Liang, Xing Wang, Huaiguang Jiang, Guanlin Chen
article en
5 citations

Abstract

We demonstrated that diffusion models are superior in accomplishing the promoter synthesis task compared to other state-of-the-art deep learning models. The effectiveness of our method was validated using data sets of <i>Escherichia coli</i> and cyanobacteria promoters, showing more stable and prompt convergence and more natural-like promoters than the variational autoencoder model. We extracted sequence information, dimer information, and position information from promoters and combined them with a transformer model to predict promoter strength. Our prediction results were more accurate than those obtained with a convolutional neural network model. Our <i>in silico</i> experiments systematically introduced mutations in promoter sequences and explored their contribution to promoter strength, highlighting the depth of learning in our model.

mSystemsVol. 10(4)
South China University of Technology (CN)
South China University of Technology, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 7%
Genomics and Phylogenetic Studies
4.03
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.