Detection of AI Generated Speech using Speech Recognition with MFCC and GMM

Generative AI-based Speech is nearly indistinguishable for a human ear. It can be misused for getting fraudulent access to a secured system, passing the wrong information or orders, committing financial frauds etc. The presented work aims to develop an AI generated speech detection system with the use of speech recognition technique for classification of AI generated speech (AI) and an authenticated human speech (H). In this work, AI Speaker Recognition has been performed in English language by the extraction of Mel Frequency Cepstral Coefficients (MFCCs). Gaussian Mixture Models (GMM) technique has been used for Classification. the human (noiseless) speech utterances and their AI generated files were used for training the GMM’s for two classes. The validation has been implemented using a large dataset of (i) Human (ii) the concatenated versions of Human of both classes (human and AI generated) with multiples of different noises such as fan sound, sound of crowd-talking, general traffic noise, light/medium and heavy rain sounds, sound on the construction site etc. (iii) the random speech samples recorded and created at multiple public places (both human and AI generated), to validate the robustness of the detection system. The recognition accuracy has been tested by varying the number of MFCCs extracted from small frames of a speech sample. More the number of (i) MFCC extracted and/or (ii) the number of training iterations and/or (iii) the number of gausses of GMM causes more recognition accuracy to a certain level but more computation time is elapsed too. An optimum combination of number of features, elapsed computation time, and accuracy is achieved. Results show that accuracy is highest (96 %) at 13 numbers of MFCCs.

Authors

Institutions

Publication Details

Published
2024-11-22
DOI
https://doi.org/10.1109/icaccm61117.2024.11059121
Citations
1
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Detection of AI Generated Speech using Speech Recognition with MFCC and GMM

Utkarsh Pant, Anshu Sharma, Abhinav Sharma
1 citations
Speech Recognition and Synthesis
0.35
article

Detection of AI Generated Speech using Speech Recognition with MFCC and GMM

Utkarsh Pant, Anshu Sharma, Abhinav Sharma
article en
1 citations

Abstract

Generative AI-based Speech is nearly indistinguishable for a human ear. It can be misused for getting fraudulent access to a secured system, passing the wrong information or orders, committing financial frauds etc. The presented work aims to develop an AI generated speech detection system with the use of speech recognition technique for classification of AI generated speech (AI) and an authenticated human speech (H). In this work, AI Speaker Recognition has been performed in English language by the extraction of Mel Frequency Cepstral Coefficients (MFCCs). Gaussian Mixture Models (GMM) technique has been used for Classification. the human (noiseless) speech utterances and their AI generated files were used for training the GMM’s for two classes. The validation has been implemented using a large dataset of (i) Human (ii) the concatenated versions of Human of both classes (human and AI generated) with multiples of different noises such as fan sound, sound of crowd-talking, general traffic noise, light/medium and heavy rain sounds, sound on the construction site etc. (iii) the random speech samples recorded and created at multiple public places (both human and AI generated), to validate the robustness of the detection system. The recognition accuracy has been tested by varying the number of MFCCs extracted from small frames of a speech sample. More the number of (i) MFCC extracted and/or (ii) the number of training iterations and/or (iii) the number of gausses of GMM causes more recognition accuracy to a certain level but more computation time is elapsed too. An optimum combination of number of features, elapsed computation time, and accuracy is achieved. Results show that accuracy is highest (96 %) at 13 numbers of MFCCs.

Graphic Era University (IN)
Gender equality
Openalex Percentile: Top 29%
Speech Recognition and Synthesis
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.