Ishara: An AI-Powered Voice-Driven Browser for Accessible Web Interaction

Ishara is an AI-powered, voice-controlled desktop browser that lets users navigate webpages, fill in forms, and get information through spoken commands instead of a mouse and keyboard. It is designed for people with motor, visual, hearing, or cognitive disabilities, including ADHD and dyslexia. Ishara pairs a conversational AI agent with access to the full DOM of the live page, so it can interpret user intent and carry out multi-step web tasks on its own. It is organized into five layers and built with Electron.js, Puppeteer, GPT-4o, Whisper, and Sarvam TTS. Accessibility modules include an ADHD focus mode, dyslexia-friendly rendering, multilingual voice interaction (English, Hindi, Marathi), AI page summarization, and an offline, in-browser 3D Indian Sign Language (ISL) avatar that signs YouTube captions and chatbot responses. In an informal pilot with five college peers, Ishara executed 44 of 50 voice commands successfully (88%), with 80-90% success across navigation, search, scrolling, playback control, and page interaction.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-13
DOI
https://doi.org/10.5281/zenodo.24204837
Primary Topic
Digital Accessibility for Disabilities
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Ishara: An AI-Powered Voice-Driven Browser for Accessible Web Interaction

Siddarth Gupta, pujari vidya, Afnan Kazi, ritika Katariya et al.
3 links
Zenodo (CERN European Organization for Nuclear Research)
Digital Accessibility for Disabilities
preprint

Ishara: An AI-Powered Voice-Driven Browser for Accessible Web Interaction

Siddarth Gupta, pujari vidya, Afnan Kazi, ritika Katariya, rutuja bhalekar
preprint en

Abstract

Ishara is an AI-powered, voice-controlled desktop browser that lets users navigate webpages, fill in forms, and get information through spoken commands instead of a mouse and keyboard. It is designed for people with motor, visual, hearing, or cognitive disabilities, including ADHD and dyslexia. Ishara pairs a conversational AI agent with access to the full DOM of the live page, so it can interpret user intent and carry out multi-step web tasks on its own. It is organized into five layers and built with Electron.js, Puppeteer, GPT-4o, Whisper, and Sarvam TTS. Accessibility modules include an ADHD focus mode, dyslexia-friendly rendering, multilingual voice interaction (English, Hindi, Marathi), AI page summarization, and an offline, in-browser 3D Indian Sign Language (ISL) avatar that signs YouTube captions and chatbot responses. In an informal pilot with five college peers, Ishara executed 44 of 50 voice commands successfully (88%), with 80-90% success across navigation, search, scrolling, playback control, and page interaction.

Zenodo (CERN European Organization for Nuclear Research)
Reduced inequalities
Digital Accessibility for Disabilities
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon