MH-CLR: A Self-Supervised Learning Strategy Based on Hard Sample Mining and Masked Autoencoders

The integration of Whole Slide Imaging (WSI) technology with artificial intelligence has significantly enhanced the analysis and application of histopathological slides. However, existing supervised learning methods for WSI analysis demand extensive time and effort to annotate high-resolution slide images. In contrast, Self-Supervised Learning (SSL) pretraining strategies, which do not depend on explicit data annotations, have emerged as a promising alternative. These SSL strategies are rapidly narrowing the performance gap with supervised learning methods. In this context, we introduce an SSL framework that dynamically adjusts the selection of negative samples during contrastive learning within the SimCLR process and incorporates masked autoencoders to reconstruct original images using latent representations and masked annotations. Notably, our approach outperforms common SSL methods in downstream classification tasks, validated through testing on the PathMNIST and our collected lung squamous carcinoma datasets.

Authors

Institutions

Publication Details

Published
2024-11-01
DOI
https://doi.org/10.1109/asid63618.2024.10839687
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MH-CLR: A Self-Supervised Learning Strategy Based on Hard Sample Mining and Masked Autoencoders

Lei Guo, Chenghan Yang, Chao Li
Machine Learning and Data Classification
article

MH-CLR: A Self-Supervised Learning Strategy Based on Hard Sample Mining and Masked Autoencoders

Lei Guo, Chenghan Yang, Chao Li
article en

Abstract

The integration of Whole Slide Imaging (WSI) technology with artificial intelligence has significantly enhanced the analysis and application of histopathological slides. However, existing supervised learning methods for WSI analysis demand extensive time and effort to annotate high-resolution slide images. In contrast, Self-Supervised Learning (SSL) pretraining strategies, which do not depend on explicit data annotations, have emerged as a promising alternative. These SSL strategies are rapidly narrowing the performance gap with supervised learning methods. In this context, we introduce an SSL framework that dynamically adjusts the selection of negative samples during contrastive learning within the SimCLR process and incorporates masked autoencoders to reconstruct original images using latent representations and masked annotations. Notably, our approach outperforms common SSL methods in downstream classification tasks, validated through testing on the PathMNIST and our collected lung squamous carcinoma datasets.

Fujian Medical University (CN), Fuzhou University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 76%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

MH-CLR: A Self-Supervised Learning Strategy Based on Hard Sample Mining and Masked Autoencoders — Lei Guo, Chenghan Yang, et al. · (2024) | TGRS Research Map | TGRS