Enhanced Recognition: A Vision Transformer Approach for Digits
Vision Transformers (ViTs) are good at applying self-attention mechanisms to learn global information, but require large datasets, are noisy, and are computationally expensive. With the introduction of few-shot learning, which reduces complexity and improves detection, particularly on small datasets like MNIST, our study overcomes these limitations. This flexibility ensures stable performance with a small number of labeled data while reducing reliance on large datasets. Our optimized model is highly effective for real-time applications, achieving an accuracy rate of 94% and an inference time of just 0.8 milliseconds per image. This study introduces a new, scalable approach to handwritten digit recognition in resource-limited environments by shifting from the feature-rich extraction ability of ViTs to the flexibility provided by few-shot learning, thus reducing computational expense and vulnerability to noise.
Authors
- Suhas Setty (ORCID: https://orcid.org/0000-0003-1602-937X)
- Krishna Prasad (ORCID: https://orcid.org/0000-0002-9090-7583)
- M. L. J. Shruthi
- Varun Sood
Institutions
- PES University (IN)
Publication Details
- Published
- 2025-05-23
- DOI
- https://doi.org/10.1109/icmlt65785.2025.11193153
- Primary Topic
- Sensor Technology and Measurement Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00