SwinTransRNA: A Swin Transformer-Based Framework for Accurate Prediction of RNA Subcellular Localization

Abstract RNA subcellular localization determines the regulatory context in which microRNAs (miRNAs), circular RNAs (circRNAs), and long noncoding RNAs (lncRNAs) exert their functions, yet these RNA classes differ greatly in sequence length and circularity, making fixed-length raw-sequence representations inconvenient for cross-RNA comparison. Here, we present SwinTransRNA, a unified framework that encodes each RNA as a length-normalized 64 × 64 frequency chaos game representation (FCGR) of 6-mer composition, where every cell carries a fixed 6-mer identity and the matrix entries sum to one, enabling direct comparison across sequence lengths. A hierarchical window-attention network captures localized interactions among neighboring composition regions and enlarges the receptive field through shifted windows and patch merging. On audited benchmark data sets for nuclear/cytoplasmic lncRNA, nuclear/cytoplasmic circRNA, and intracellular/extracellular miRNA classification, SwinTransRNA achieves the highest accuracy and F1 among the compared methods on all three tasks (0.748/0.723, 0.914/0.908, and 0.819/0.823 for lncRNA, miRNA, and circRNA, respectively), surpassing RNALight and RNALoc-LM. Ablations show consistent gains over one-hot Transformer baselines and classical FCGR-based classifiers, while feature-space and curve-level analyses characterize the complementary contributions of the FCGR representation and the window-attention backbone. The main novelty lies in combining an order-traceable FCGR with hierarchical window attention under a reproducible protocol: five-seed repeats, confidence intervals, and paired tests quantify comparison uncertainty, and patch-embedding heatmaps with candidate motif screens expose the patterns prioritized by the model. The unified implementation, traceable sequence processing, and compact 4.25-million-parameter model provide a fixed-dimensional, auditable basis for RNA localization prediction and pattern prioritization.

Authors

Institutions

Publication Details

Journal
Journal of Chemical Information and Modeling
Published
2026-09-22
DOI
https://doi.org/10.1021/acs.jcim.6c02004
Primary Topic
Machine Learning in Bioinformatics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

SwinTransRNA: A Swin Transformer-Based Framework for Accurate Prediction of RNA Subcellular Localization

Jijun Tang, Tzong-Yi Lee, Leyi Wei, Yixian Huang et al.
Journal of Chemical Information and Modeling
Machine Learning in Bioinformatics
article

SwinTransRNA: A Swin Transformer-Based Framework for Accurate Prediction of RNA Subcellular Localization

Jijun Tang, Tzong-Yi Lee, Leyi Wei, Yixian Huang, Lantian Yao, Jiahui Guan, Xingchen Liu, Yen-Peng Chiu, Peilin Xie, Xi He, Bowen Shi, Zhihao Zhao, Xiangrong Liu
article en

Abstract

Abstract RNA subcellular localization determines the regulatory context in which microRNAs (miRNAs), circular RNAs (circRNAs), and long noncoding RNAs (lncRNAs) exert their functions, yet these RNA classes differ greatly in sequence length and circularity, making fixed-length raw-sequence representations inconvenient for cross-RNA comparison. Here, we present SwinTransRNA, a unified framework that encodes each RNA as a length-normalized 64 × 64 frequency chaos game representation (FCGR) of 6-mer composition, where every cell carries a fixed 6-mer identity and the matrix entries sum to one, enabling direct comparison across sequence lengths. A hierarchical window-attention network captures localized interactions among neighboring composition regions and enlarges the receptive field through shifted windows and patch merging. On audited benchmark data sets for nuclear/cytoplasmic lncRNA, nuclear/cytoplasmic circRNA, and intracellular/extracellular miRNA classification, SwinTransRNA achieves the highest accuracy and F1 among the compared methods on all three tasks (0.748/0.723, 0.914/0.908, and 0.819/0.823 for lncRNA, miRNA, and circRNA, respectively), surpassing RNALight and RNALoc-LM. Ablations show consistent gains over one-hot Transformer baselines and classical FCGR-based classifiers, while feature-space and curve-level analyses characterize the complementary contributions of the FCGR representation and the window-attention backbone. The main novelty lies in combining an order-traceable FCGR with hierarchical window attention under a reproducible protocol: five-seed repeats, confidence intervals, and paired tests quantify comparison uncertainty, and patch-embedding heatmaps with candidate motif screens expose the patterns prioritized by the model. The unified implementation, traceable sequence processing, and compact 4.25-million-parameter model provide a fixed-dimensional, auditable basis for RNA localization prediction and pattern prioritization.

Journal of Chemical Information and Modeling
National Yang Ming Chiao Tung University (TW), Xiamen University (CN), Chinese University of Hong Kong, Shenzhen (CN), Shenzhen Technology University (CN), Shenzhen University of Advanced Technology (CN), Macao Polytechnic University (MO), Xiamen University of Technology (CN), University of Hong Kong (HK)
Openalex Percentile: Top 18%
Machine Learning in Bioinformatics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.