Pixenta: AI-Powered Intent-Aware Screenshot Assistant for Transforming Screenshots into Intelligent Actions
The widespread use of digital devices has made screenshots a convenient way to preserve information from shopping platforms, travel services, educational portals, event listings, and online communications. However, conventional gallery-based storage generally treats screenshots as images rather than as information-bearing records connected to a user's possible goals. This paper presents Pixenta, a prototype concept for an intent-aware screenshot assistant designed to move beyond passive image storage toward information extraction and contextual action recommendation. The current prototype provides a Streamlit-based interface for screenshot upload and uses Pillow for image handling and PaddleOCR for text extraction. A preliminary functional check was performed using a shopping screenshot, from which visible product and offer information was extracted. The broader proposed pipeline includes visual-context analysis, structured information extraction, semantic representation, similarity-based grouping, intent classification, and user-approved action recommendations such as price tracking or reminders. These advanced stages are presented as the system's proposed design and are not claimed as experimentally validated in the current prototype. The paper documents the motivation, architecture, preliminary implementation, evaluation plan, limitations, and future development of Pixenta.
Authors
- Sayyad Isma
- Shiddhant Shukla
- Shivendra Pratap Singh
Publication Details
- Journal
- International Journal for Research in Applied Science and Engineering Technology
- Published
- 2026-11-16
- DOI
- https://doi.org/10.22214/ijraset.2026.85686
- Primary Topic
- Handwritten Text Recognition Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00