Drawing on screen using P5.js and ml5.js

This paper presents a novel approach to creating an interactive drawing application using hand pose detection. The system leverages ML5.js (a machine learning library) and P5.js (a creative coding library) to detect hand gestures in real-time and translate them into drawing actions on a canvas. By tracking the distance between the thumb and other fingers of the user's hand, the system enables the creation of a virtual paintbrush with different colors. Additionally, the system allows users to erase the canvas by joining all fingers of the right hand. The brush size can be dynamically adjusted based on the distance between the forefinger and thumb of the left hand. This project demonstrates the potential of combining machine learning and creative coding for intuitive human-computer interaction.

Authors

Institutions

Publication Details

Journal
International Journal For Multidisciplinary Research
Published
2025-04-20
DOI
https://doi.org/10.36948/ijfmr.2025.v07i02.40882
Primary Topic
Computational Physics and Python Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Drawing on screen using P5.js and ml5.js

Aryan lakhanpal, Aryan Pandey
International Journal For Multidisciplinary Research
Computational Physics and Python Applications
article

Drawing on screen using P5.js and ml5.js

Aryan lakhanpal, Aryan Pandey
article en

Abstract

This paper presents a novel approach to creating an interactive drawing application using hand pose detection. The system leverages ML5.js (a machine learning library) and P5.js (a creative coding library) to detect hand gestures in real-time and translate them into drawing actions on a canvas. By tracking the distance between the thumb and other fingers of the user's hand, the system enables the creation of a virtual paintbrush with different colors. Additionally, the system allows users to erase the canvas by joining all fingers of the right hand. The brush size can be dynamically adjusted based on the distance between the forefinger and thumb of the left hand. This project demonstrates the potential of combining machine learning and creative coding for intuitive human-computer interaction.

International Journal For Multidisciplinary ResearchVol. 7(2)
Institute of Management Technology (IN)
Openalex Percentile: Top 96%
Computational Physics and Python Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.