Shapley Values-Enabled Progressive Pseudo Bag Augmentation for Whole-Slide Image Classification

In computational pathology, whole-slide image (WSI) classification presents a formidable challenge due to its gigapixel resolution and limited fine-grained annotations. Multiple-instance learning (MIL) offers a weakly supervised solution, yet refining instance-level information from bag-level labels remains challenging. While most of the conventional MIL methods use attention scores to estimate instance importance scores (IIS) which contribute to the prediction of the slide labels, these often lead to skewed attention distributions and inaccuracies in identifying crucial instances. To address these issues, we propose a new approach inspired by cooperative game theory: employing Shapley values to assess each instance's contribution, thereby improving IIS estimation. The computation of the Shapley value is then accelerated using attention, meanwhile retaining the enhanced instance identification and prioritization. We further introduce a framework for the progressive assignment of pseudo bags based on estimated IIS, encouraging more balanced attention distributions in MIL models. Our extensive experiments on CAMELYON-16, BRACS, TCGA-LUNG, and TCGA-BRCA datasets show our method's superiority over existing state-of-the-art approaches, offering enhanced interpretability and class-wise insights. Our source code is available at https://github.com/RenaoYan/PMIL.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Medical Imaging
Published
2024-09-02
DOI
https://doi.org/10.1109/tmi.2024.3453386
Citations
13
Primary Topic
Image Retrieval and Classification Techniques
Type
article
Field-Weighted Citation Impact
3.24

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Shapley Values-Enabled Progressive Pseudo Bag Augmentation for Whole-Slide Image Classification

Qiehe Sun, Renao Yan, Hao Chen, Yonghong He et al.
13 citations
IEEE Transactions on Medical Imaging
Image Retrieval and Classification Techniques
3.24
article

Shapley Values-Enabled Progressive Pseudo Bag Augmentation for Whole-Slide Image Classification

Qiehe Sun, Renao Yan, Hao Chen, Yonghong He, Yiqing Liu, Cheng Jin, Tian Guan
article en
13 citations

Abstract

In computational pathology, whole-slide image (WSI) classification presents a formidable challenge due to its gigapixel resolution and limited fine-grained annotations. Multiple-instance learning (MIL) offers a weakly supervised solution, yet refining instance-level information from bag-level labels remains challenging. While most of the conventional MIL methods use attention scores to estimate instance importance scores (IIS) which contribute to the prediction of the slide labels, these often lead to skewed attention distributions and inaccuracies in identifying crucial instances. To address these issues, we propose a new approach inspired by cooperative game theory: employing Shapley values to assess each instance's contribution, thereby improving IIS estimation. The computation of the Shapley value is then accelerated using attention, meanwhile retaining the enhanced instance identification and prioritization. We further introduce a framework for the progressive assignment of pseudo bags based on estimated IIS, encouraging more balanced attention distributions in MIL models. Our extensive experiments on CAMELYON-16, BRACS, TCGA-LUNG, and TCGA-BRCA datasets show our method's superiority over existing state-of-the-art approaches, offering enhanced interpretability and class-wise insights. Our source code is available at https://github.com/RenaoYan/PMIL.

IEEE Transactions on Medical ImagingVol. 44(1)
Hong Kong University of Science and Technology (HK), University Town of Shenzhen (CN), Tsinghua–Berkeley Shenzhen Institute (CN), University of Hong Kong (HK), Tsinghua University (CN)
National Natural Science Foundation of China, Innovation and Technology Commission - Hong Kong
Openalex Percentile: Top 7%
Image Retrieval and Classification Techniques
3.24
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.