An Effective Approach to Speech-Based Email Assistance for Visually Impaired People

The Speech-based Email Assistant aims to promote digital inclusivity for the blind by allowing email operations to be done hands-free via voice commands. The system is capable of uninterrupted use without any visual input, using the OpenAI Whisper model for converting speech to text and the Google Text-to-Speech (GTTS) package for providing auditory feedback. The application allows for creating, sending, retrieving, managing mailboxes, and summarizing email messages, thus providing basic Natural Language Processing (NLP) functions. Voice input is in live mode through PyAudio, and emails are sent over secure channels using SMTP and IMAP for email operations. Voice authentication alongside SHA-256 hashing is applied to enhance security, providing protection against unauthorized access while ensuring user privacy. This research aims to develop a voice-based email assistant that is user-friendly, efficient, and secure, thus promoting the digitally inclusive training of visually impaired users.

Authors

Institutions

Publication Details

Published
2025-04-24
DOI
https://doi.org/10.1109/icoei65986.2025.11013019
Primary Topic
Tactile and Sensory Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Effective Approach to Speech-Based Email Assistance for Visually Impaired People

Sherin Eliyas, H. S.
Tactile and Sensory Interactions
article

An Effective Approach to Speech-Based Email Assistance for Visually Impaired People

Sherin Eliyas, H. S.
article en

Abstract

The Speech-based Email Assistant aims to promote digital inclusivity for the blind by allowing email operations to be done hands-free via voice commands. The system is capable of uninterrupted use without any visual input, using the OpenAI Whisper model for converting speech to text and the Google Text-to-Speech (GTTS) package for providing auditory feedback. The application allows for creating, sending, retrieving, managing mailboxes, and summarizing email messages, thus providing basic Natural Language Processing (NLP) functions. Voice input is in live mode through PyAudio, and emails are sent over secure channels using SMTP and IMAP for email operations. Voice authentication alongside SHA-256 hashing is applied to enhance security, providing protection against unauthorized access while ensuring user privacy. This research aims to develop a voice-based email assistant that is user-friendly, efficient, and secure, thus promoting the digitally inclusive training of visually impaired users.

Hindustan Institute of Technology and Science (IN)
Openalex Percentile: Top 89%
Tactile and Sensory Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.