Gesture-Driven Cartoonification: A Text-based Approach Leveraging AI and Computer Vision for Creative Expression
To make a new pipeline for real-time hand gesture-based cartoonification possible, this research provides an all-inclusive system that integrates OpenCV, deep learning architectures, and OpenAI APIs. The four main components of the suggested system architecture are air gesture recognition for virtual writing, handwriting-to-digital-text conversion using a CNN, text-to-image generation using OpenAI APIs for cartoonification, and deployment on an interactive web interface. Using hand motions, the air canvas module gives means to write text in midair. High-performance CNN models process and translate it into digital format with very high accuracy. With an application of cutting-edge generative AI frameworks, the digital text becomes a prompt for generating cartoonized pictures. These technologies deal with the restrictions and limitations that exist with an area of direct picture drawing, such as ambiguity, inefficiency, and decreased precision. This is because the system contributes significantly to computer vision, human-computer interaction, and creating original content through its smooth, user-friendly interface and real-time performance optimization.
Authors
- Atul Sangal (ORCID: https://orcid.org/0000-0002-4078-7210)
- Tushar Chauhan (ORCID: https://orcid.org/0000-0002-0396-4820)
- Khushi Gupta (ORCID: https://orcid.org/0000-0002-4452-5103)
- Sidharth Pradhan (ORCID: https://orcid.org/0000-0002-3485-9687)
Institutions
- Amity University (AE)
Publication Details
- Published
- 2025-05-21
- DOI
- https://doi.org/10.1109/icaiss61471.2025.11041701
- Primary Topic
- Virtual Reality Applications and Impacts
- Type
- article
- Field-Weighted Citation Impact
- 0.00