AI-Assisted Test Script Generation for GUI Applications
Automated testing is crucial for ensuring the quality and reliability of modern software applications, especially those with complex graphical user interfaces (GUIs). However, traditional approaches to GUI testing, such as record-and-replay and manual script generation, are often labor-intensive and fail to capture the dynamic nature of user interactions. This paper presents a novel AI-assisted framework for automatically generating test scripts for GUI applications. By leveraging advancements in computer vision and reinforcement learning, the framework accurately detects GUI elements, models user interactions, and generates effective test sequences to validate expected application behavior. The system is evaluated on a diverse set of GUI applications, demonstrating superiority over existing testing methods in terms of test coverage, script generation efficiency, and fault detection capabilities. The results highlight the potential of AI-powered techniques to transform GUI testing, enabling more robust and scalable software development processes.
Authors
- Sanjiv Kapoor (ORCID: https://orcid.org/0000-0001-5637-9919)
Institutions
- Amazon (United States) (US)
Publication Details
- Published
- 2025-01-09
- DOI
- https://doi.org/10.1109/icaect63952.2025.10958949
- Citations
- 1
- Primary Topic
- Software Testing and Debugging Techniques
- Type
- article
- Field-Weighted Citation Impact
- 2.31