Gesture Showdown: Rock Paper Scissors with AI Vision

This paper presents a gesture-based RockPaper-Scissors game that leverages computer vision and hand gesture recognition to enable intuitive human-computer interaction. Utilizing MediaPipe's pre-trained hand tracking module, the system detects and identifies 21 hand landmarks in real-time to classify gestures as rock, paper or scissors based on angular relationships between key points. OpenCV is used for webcam integration and video frame preprocessing, ensuring seamless interaction. The game compares the recognized gesture with a computer-generated move, dynamically displaying the results and resetting after each round for continuous play. The system identifies gestures through precise angle calculations, differentiating between closed fists, open palms and extended fingers. Sample outputs demonstrate real-time gameplay scenarios, highlighting gesture recognition accuracy and user engagement. Future enhancements include refining recognition accuracy, adding multiplayer functionality, introducing customizable gestures, and deploying the game on web and mobile platforms for broader accessibility. This project showcases the potential of integrating AI and computer vision in creating engaging and user-friendly applications.

Authors

Publication Details

Published
2025-02-07
DOI
https://doi.org/10.1109/icccit62592.2025.10928086
Primary Topic
Ethics and Social Impacts of AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Gesture Showdown: Rock Paper Scissors with AI Vision

Y. D., Nikita Shravan, Kaustav Bose, Hemal Babu H
Ethics and Social Impacts of AI
article

Gesture Showdown: Rock Paper Scissors with AI Vision

Y. D., Nikita Shravan, Kaustav Bose, Hemal Babu H
article en

Abstract

This paper presents a gesture-based RockPaper-Scissors game that leverages computer vision and hand gesture recognition to enable intuitive human-computer interaction. Utilizing MediaPipe's pre-trained hand tracking module, the system detects and identifies 21 hand landmarks in real-time to classify gestures as rock, paper or scissors based on angular relationships between key points. OpenCV is used for webcam integration and video frame preprocessing, ensuring seamless interaction. The game compares the recognized gesture with a computer-generated move, dynamically displaying the results and resetting after each round for continuous play. The system identifies gestures through precise angle calculations, differentiating between closed fists, open palms and extended fingers. Sample outputs demonstrate real-time gameplay scenarios, highlighting gesture recognition accuracy and user engagement. Future enhancements include refining recognition accuracy, adding multiplayer functionality, introducing customizable gestures, and deploying the game on web and mobile platforms for broader accessibility. This project showcases the potential of integrating AI and computer vision in creating engaging and user-friendly applications.

Openalex Percentile: Top 95%
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.