Selective representation learning boosts intrinsically disordered protein prediction from pretrained language models

Background Intrinsically disordered proteins and intrinsically disordered regions lack stable tertiary structures yet play indispensable roles in cellular signaling, regulation, and disease processes. Predicting disorder from sequence alone remains a fundamental challenge in computational biology. Recent advances in pretrained protein language models have shown great potential in capturing rich contextual representations. However, hierarchical pretrained protein language model features suffer from token-level noise and multi-layer redundancy, which limits their efficacy in downstream tasks. Methods In this work, we present SRLIDP, a selective representation learning framework designed to extract disorder-relevant signals from PPLMs. SRLIDP employs a dual-granularity selection strategy: at the token level, a Depth-Adaptive Retention Schedule (DARS) with Gumbel-Sigmoid differentiable relaxation filters uninformative residue noise; at the layer level, a dynamic cross-layer attention mechanism aggregates contextualized representations, followed by a bidirectional GRU module to restore global sequence context. Furthermore, to minimize potential homology-related data leakage, a strict multi-stage homology filtering pipeline (<25% sequence identity) was established across all evaluation benchmarks (Clean MXD494, SL329, DISORDER723, CAID3_NOX, and CAID3_PDB). Results Extensive evaluations on these strictly filtered benchmarks indicate that SRLIDP exhibits highly competitive performance compared to several representative baseline predictors, achieving robust cross-dataset generalization while maintaining high computational efficiency. Conclusion Our findings establish SRLIDP as a robust, rigorously homology-filtered, and effective solution for protein disorder prediction, with broad implications for functional analysis and therapeutic discovery.

Authors

Institutions

Publication Details

Journal
Frontiers in Genetics
Published
2026-11-09
DOI
https://doi.org/10.3389/fgene.2026.1918538
Primary Topic
Protein Structure and Dynamics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Selective representation learning boosts intrinsically disordered protein prediction from pretrained language models

苗书梅, Mang Jing, Tiantian Li, Yun Liu et al.
Frontiers in Genetics
Protein Structure and Dynamics
article

Selective representation learning boosts intrinsically disordered protein prediction from pretrained language models

苗书梅, Mang Jing, Tiantian Li, Yun Liu, Tingyu Xu, Yining Hu
article en

Abstract

Background Intrinsically disordered proteins and intrinsically disordered regions lack stable tertiary structures yet play indispensable roles in cellular signaling, regulation, and disease processes. Predicting disorder from sequence alone remains a fundamental challenge in computational biology. Recent advances in pretrained protein language models have shown great potential in capturing rich contextual representations. However, hierarchical pretrained protein language model features suffer from token-level noise and multi-layer redundancy, which limits their efficacy in downstream tasks. Methods In this work, we present SRLIDP, a selective representation learning framework designed to extract disorder-relevant signals from PPLMs. SRLIDP employs a dual-granularity selection strategy: at the token level, a Depth-Adaptive Retention Schedule (DARS) with Gumbel-Sigmoid differentiable relaxation filters uninformative residue noise; at the layer level, a dynamic cross-layer attention mechanism aggregates contextualized representations, followed by a bidirectional GRU module to restore global sequence context. Furthermore, to minimize potential homology-related data leakage, a strict multi-stage homology filtering pipeline (<25% sequence identity) was established across all evaluation benchmarks (Clean MXD494, SL329, DISORDER723, CAID3_NOX, and CAID3_PDB). Results Extensive evaluations on these strictly filtered benchmarks indicate that SRLIDP exhibits highly competitive performance compared to several representative baseline predictors, achieving robust cross-dataset generalization while maintaining high computational efficiency. Conclusion Our findings establish SRLIDP as a robust, rigorously homology-filtered, and effective solution for protein disorder prediction, with broad implications for functional analysis and therapeutic discovery.

Frontiers in GeneticsVol. 17
Southeast University (BD), Jiangsu Province Hospital (CN), Southeast University (CN), Nanjing Medical University (CN)
Protein Structure and Dynamics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon