iEnhancer-XLNet3D: an enhancer identification method based on 3-mer tokenization optimization and encoder deep perception

Enhancers are non-coding regulatory elements whose sequence patterns are diverse and context-dependent, making accurate identification from DNA sequence alone challenging. This study presents iEnhancer-XLNet3D, an enhancer prediction framework that combines global contextual encoding with local pattern refinement under a unified fine-tuning pipeline. Given a fixed-length DNA sequence, we apply overlapping 3-mer tokenization and reconstruct a compact 3-mer embedding to adapt XLNet-Base for genomic input (DNA3_XLNet). To better exploit complementary information across network depths, we introduce FUSE_ENCODER to aggregate full-layer representations, and refine the fused features using a lightweight dual depthwise-separable convolution module (DDS_CNN) before classification. The model is evaluated on the canonical enhancer benchmark for Stage-1 (enhancer vs. non-enhancer) and Stage-2 (strong vs. weak enhancer). Under a unified protocol, we compare against representative prior methods as well as modern pretrained baselines (including DNABERT-2 and a small Nucleotide Transformer) fine-tuned under the same conditions. On the independent test set, iEnhancer-XLNet3D attains 86.7% AUC on Stage-1 and 96.6% AUC on Stage-2. Ablation analyses suggest that DNA3_XLNet, layer fusion, and convolutional refinement provide complementary contributions. Model weights are publicly available at: https://github.com/tilerons/iEnhancer-XLNet3D.

Authors

Institutions

Publication Details

Journal
Journal of King Saud University - Computer and Information Sciences
Published
2026-02-23
DOI
https://doi.org/10.1007/s44443-026-00555-3
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

iEnhancer-XLNet3D: an enhancer identification method based on 3-mer tokenization optimization and encoder deep perception

Siqi Zhan, FangLi Li, ZhiZhan Xu, TaoTao Wang
Journal of King Saud University - Computer and Information Sciences
Advanced Neural Network Applications
article

iEnhancer-XLNet3D: an enhancer identification method based on 3-mer tokenization optimization and encoder deep perception

Siqi Zhan, FangLi Li, ZhiZhan Xu, TaoTao Wang
article en

Abstract

Enhancers are non-coding regulatory elements whose sequence patterns are diverse and context-dependent, making accurate identification from DNA sequence alone challenging. This study presents iEnhancer-XLNet3D, an enhancer prediction framework that combines global contextual encoding with local pattern refinement under a unified fine-tuning pipeline. Given a fixed-length DNA sequence, we apply overlapping 3-mer tokenization and reconstruct a compact 3-mer embedding to adapt XLNet-Base for genomic input (DNA3_XLNet). To better exploit complementary information across network depths, we introduce FUSE_ENCODER to aggregate full-layer representations, and refine the fused features using a lightweight dual depthwise-separable convolution module (DDS_CNN) before classification. The model is evaluated on the canonical enhancer benchmark for Stage-1 (enhancer vs. non-enhancer) and Stage-2 (strong vs. weak enhancer). Under a unified protocol, we compare against representative prior methods as well as modern pretrained baselines (including DNABERT-2 and a small Nucleotide Transformer) fine-tuned under the same conditions. On the independent test set, iEnhancer-XLNet3D attains 86.7% AUC on Stage-1 and 96.6% AUC on Stage-2. Ablation analyses suggest that DNA3_XLNet, layer fusion, and convolutional refinement provide complementary contributions. Model weights are publicly available at: https://github.com/tilerons/iEnhancer-XLNet3D.

Journal of King Saud University - Computer and Information Sciences
Jiangxi University of Technology (CN)
Openalex Percentile: Top 48%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.