Infusing Emotion in Text to Speech Model

Text-to-Speech (TTS) systems have achieved remarkable proficiency in generating natural-sounding speech. However the synthesized speech from these systems often ends up sounding robotic or machine like because it lacks the emotional qualities that humans have when they speak. Approach for emotional TTS is presented in order to overcome this constraint. Using emotion vectors taken from expressive voice samples, this method improves the text embedding by adding emotion from pre-trained models such as Tacotron. This paper adapt current TTS framework and include emotion vectors with textual input and produce emotionally complex voice output. This research project aims to make important improvements in the field of TTS synthesis, which will eventually improve the quality and naturalness of human-computer interactions.

Authors

Institutions

Publication Details

Published
2024-11-13
DOI
https://doi.org/10.1109/ictacs62700.2024.10841022
Citations
1
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Infusing Emotion in Text to Speech Model

Rupesh Kumar Yadav, Shweta Chauhan, Sudip Thapa, Abdul Rahman Mohammed et al.
1 citations
Speech and dialogue systems
0.35
article

Infusing Emotion in Text to Speech Model

Rupesh Kumar Yadav, Shweta Chauhan, Sudip Thapa, Abdul Rahman Mohammed, Yared Alemayehu
article en
1 citations

Abstract

Text-to-Speech (TTS) systems have achieved remarkable proficiency in generating natural-sounding speech. However the synthesized speech from these systems often ends up sounding robotic or machine like because it lacks the emotional qualities that humans have when they speak. Approach for emotional TTS is presented in order to overcome this constraint. Using emotion vectors taken from expressive voice samples, this method improves the text embedding by adding emotion from pre-trained models such as Tacotron. This paper adapt current TTS framework and include emotion vectors with textual input and produce emotionally complex voice output. This research project aims to make important improvements in the field of TTS synthesis, which will eventually improve the quality and naturalness of human-computer interactions.

Chandigarh University (IN), Atal Bihari Vajpayee Indian Institute of Information Technology and Management (IN)
National University of Singapore
Openalex Percentile: Top 30%
Speech and dialogue systems
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Infusing Emotion in Text to Speech Model — Rupesh Kumar Yadav, Shweta Chauhan, et al. · (2024) | TGRS Research Map | TGRS