HRProtoKD: A hierarchical and relational prototype based knowledge distillation framework for few-shot cancer molecular subtyping
Accurate molecular subtyping of cancers is critical for drug discovery and disease treatment but re-mains challenging due to the scarcity of labeled data and the intrinsic heterogeneity of cancer biology. While current methods address this issue via few-shot learning (FSL), they often overlook the hierarchical relation-ships among cancer subtypes and the transfer of relational knowledge between models, both of which are crucial for improving generalization under limited supervision. In this work, we propose HRProtoKD, a novel hierarchical and relational prototype-based knowledge distillation framework designed for few-shot cancer subtype classification. HRProtoKD first employs hierarchical inter-class prototype clustering to capture the underlying class relationships. A prototype-wise contrastive loss is then introduced to enhance intra-class compactness and interclass separability. Furthermore, relational prototype knowledge distillation is applied to transfer structural knowledge from a teacher model to a student model. In addition, we construct three benchmark datasets for few-shot cancer molecular subtyping. Extensive experiments conducted on these datasets demonstrate that HRProtoKD consistently outperforms state-of-the-art meta-learning baselines under both 1-shot and 5-shot learning settings, thereby advancing precision oncology and supporting data-driven approaches for drug discovery and therapeutic development.
Authors
- Hui Cui (ORCID: https://orcid.org/0000-0001-8224-4698)
- Ping Xuan (ORCID: https://orcid.org/0000-0001-5328-691X)
- Leyi Wei (ORCID: https://orcid.org/0000-0003-1444-190X)
- Ran Su
- Run Shi (ORCID: https://orcid.org/0000-0002-1333-0637)
- Fei Guo (ORCID: https://orcid.org/0009-0004-2149-7228)
- Qiangguo Jin (ORCID: https://orcid.org/0000-0002-1781-1067)
- Xikang Feng (ORCID: https://orcid.org/0000-0003-4029-3795)
- Jia Zhou (ORCID: https://orcid.org/0009-0007-7320-533X)
Institutions
- Tianjin University (CN)
- Northwestern Polytechnical University (CN)
- La Trobe University (AU)
- Shantou University (CN)
- Suzhou Institute of Trade & Commerce (CN)
- Tianjin Chest Hospital (CN)
- Wuhan University of Science and Technology (CN)
- Macao Polytechnic University (MO)
Publication Details
- Journal
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/jbhi.2025.3611646
- Primary Topic
- Computational Drug Discovery Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00