Ensembles of deep one-class classifiers for multi-class image classification

Traditional methods for multi-class classification (MCC) involve using a monolithic feature extractor and classifier trained on data from all the classes simultaneously. These methods are dependent on the number and types of classes and are therefore rigid against changes to the class structure. For instance, if the number of classes needs to be modified or new training data becomes available, retraining would be required for optimum classification performance. Moreover, these classifiers can become biased toward classes with a large data imbalance. An alternative, more attractive framework is to consider an ensemble of one-class classifiers (EOCC) where each one-class classifier (OCC) is trained with data from a single class only, without using any information from the other classes. Although this framework has not yet systematically matched or surpassed the performance of traditional MCC approaches, it deserves further investigation for several reasons. First, it provides a more flexible framework for handling changes in class structure compared to the traditional MCC approach. Second, it is less biased toward classes with large data imbalances compared to the multi-class classification approach. Finally, each OCC can be separately optimized depending on the characteristics of the class it represents. In this paper, we have performed extensive experiments to evaluate EOCC for MCC using traditional OCCs based on Principal Component Analysis (PCA) and Auto-encoders (AE) as well as newly proposed OCCs based on Generative Adversarial Networks (GANs). Moreover, we have compared the performance of EOCC with traditional multi-class DL classifiers including VGG-19, Resnet and EfficientNet. Two different datasets were used in our experiments: (i) a subset from the Plant Village dataset plant disease dataset with high variance in the number of classes and amount of data in each class, and (ii) an Alzheimer’s disease dataset with low amounts of data and a large imbalance in data between classes. Our results show that the GAN-based EOCC outperform previous EOCC approaches and improve the performance gap with traditional MCC approaches. • Investigated the problem of designing ensembles of one-class classifiers (EOCC) for solving multi-class classification (MCC) problems. • Extensive review of related methods. • Benchmarked EOCC based on traditional one-class classifiers (i.e., PCA and Auto-encoders). • Introduced new one-class classifiers based on Generative Adversarial Networks (GANs) • Benchmarked EOCC based on GAN-based one-class classifiers. • Compared EOCC with traditional multi-class classifiers (largely ignored in the literature). • Demonstrated that the new GAN-based EOCC approach outperforms previous EOCC approaches. • Demonstrated that the new GAN-based EOCC approach improves the performance gap with traditional MCC approaches. • Demonstrated the advantages of EOCC by varying the class structure (i.e., adding or removing classes). • Use realistic image datasets in our classification experiments.