Self-supervision with quantum classifiers

Self-supervised learning (SSL) has emerged as a novel method for learning representations from inputs without data annotations. A key challenge in SSL is avoiding the collapse of representations, leading to poor predictive models. This research proposes an SSL framework that leverages quantum classifiers to address this issue. We achieve well-stratified, nontrivial representations by embedding data into the Hilbert space via quantum classifiers. The algorithm works by minimizing the Kullback-Leibler (KL) divergence to maximize the agreement of positive pairs and minimize the agreement of negative pairs. We demonstrate the proof-of-concept in image classification tasks using MNIST, KMNIST, and FashionMNIST datasets. Classifiers trained with our framework achieve higher predictive performance than classical classifiers, with a maximum accuracy of 65% on MNIST and more than 70% on KMNIST and FashionMNIST using unseen samples without fine-tuning. The code implementation is available at https://github.com/namhai03/QSSL

Authors

Institutions

Publication Details

Journal
Nonlinear Theory and Its Applications IEICE
Published
2025-01-01
DOI
https://doi.org/10.1587/nolta.16.777
Primary Topic
Quantum Computing Algorithms and Architecture
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Self-supervision with quantum classifiers

Hoang Duy Ngo, Ngoc-Quan Nguyen, Nam V. Nguyen, M. T. Tran
Nonlinear Theory and Its Applications IEICE
Quantum Computing Algorithms and Architecture
article

Self-supervision with quantum classifiers

Hoang Duy Ngo, Ngoc-Quan Nguyen, Nam V. Nguyen, M. T. Tran
article en

Abstract

Self-supervised learning (SSL) has emerged as a novel method for learning representations from inputs without data annotations. A key challenge in SSL is avoiding the collapse of representations, leading to poor predictive models. This research proposes an SSL framework that leverages quantum classifiers to address this issue. We achieve well-stratified, nontrivial representations by embedding data into the Hilbert space via quantum classifiers. The algorithm works by minimizing the Kullback-Leibler (KL) divergence to maximize the agreement of positive pairs and minimize the agreement of negative pairs. We demonstrate the proof-of-concept in image classification tasks using MNIST, KMNIST, and FashionMNIST datasets. Classifiers trained with our framework achieve higher predictive performance than classical classifiers, with a maximum accuracy of 65% on MNIST and more than 70% on KMNIST and FashionMNIST using unseen samples without fine-tuning. The code implementation is available at https://github.com/namhai03/QSSL

Nonlinear Theory and Its Applications IEICEVol. 16(3)
Phenikaa University (VN)
Openalex Percentile: Top 92%
Quantum Computing Algorithms and Architecture
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.