Explainable rotation-invariant self-supervised representation learning
This paper describes a method that can perform robust detection and classification in out-of-distribution rotated images in the medical domain. In real-world medical imaging tools, noise due to the rotation of the body part is frequently observed. This noise reduces the accuracy of AI-based classification and prediction models. Hence, it is important to develop models which are rotation invariant. To that end, the proposed method - RISC (rotation invariant self-supervised vision framework) addresses this issue of rotational corruption. We present state-of-the-art rotation-invariant classification results and provide explainability for the performance in the domain. The evaluation of the proposed method is carried out on real-world adversarial examples in Medical Imagery-OrganAMNIST, RetinaMNIST and PneumoniaMNIST. It is observed that RISC outperforms the rotation-affected benchmark methods by obtaining 22\%, 17\% and 2\% accuracy boost on OrganAMNIST, PneumoniaMNIST and RetinaMNIST rotated baselines respectively. Further, explainability results are demonstrated. This methods paper describes:•a representation learning approach that can perform robust detection and classification in out-of-distribution rotated images in the medical domain.•It presents a method that incorporates self-supervised rotation invariance for correcting rotational corruptions.•GradCAM-based explainability for the rotational SSL pretext task and the downstream classification outcomes for the three benchmark datasets are presented.
Authors
- Devansh Singh
- Rahee Walambe (ORCID: https://orcid.org/0000-0003-1745-5231)
- Ketan Kotecha (ORCID: https://orcid.org/0000-0003-2653-3780)
- Aboli Marathe (ORCID: https://orcid.org/0000-0002-8869-8137)
- Sidharth Roy (ORCID: https://orcid.org/0000-0002-6344-6769)
Institutions
- Symbiosis International University (IN)
- Carnegie Mellon University (US)
- University of Pennsylvania (US)
Publication Details
- Journal
- MethodsX
- Published
- 2024-09-13
- DOI
- https://doi.org/10.1016/j.mex.2024.102959
- Primary Topic
- Anomaly Detection Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00