Djupinlärningsbaserat Tydligare Tal i Digitalt Underhållningsmaterial

Speech intelligibility in stereo audio remains a persistent challenge for digital entertainment content, particularly for users with hearing impairments. This thesis investigates the potential of a deep learning-based approach to improve speech clarity in stereo formats, using content from Sveriges Television AB (SVT). A fullband speech enhancement model, DeepFilterNet, was applied through two processing strategies: discrete-channel enhancement and a novel Center Enhanced Stereo (CES) method. These were compared to SVT’s existing FFmpeg-based Dialogue Enhance (DE) solution through both objective and subjective evaluations. Objective analysis was performed using non-intrusive metrics Non-Intrusive Speech Quality Assessment (NISQA) and Deep Noise Supression Mean Opinion Score (DNSMOS), while subjective assessments involved over 1,000 SVT Play users rating paired clips across diverse genres. Results indicate that CES consistently improves speech clarity without compromising background audio quality. These findings demonstrate the feasibility of integrating deep learning models into existing streaming pipelines, offering meaningful improvements in accessibility and user experience.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Djupinlärningsbaserat Tydligare Tal i Digitalt Underhållningsmaterial

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Speech and Audio Processing
article

Djupinlärningsbaserat Tydligare Tal i Digitalt Underhållningsmaterial

article en

Abstract

Speech intelligibility in stereo audio remains a persistent challenge for digital entertainment content, particularly for users with hearing impairments. This thesis investigates the potential of a deep learning-based approach to improve speech clarity in stereo formats, using content from Sveriges Television AB (SVT). A fullband speech enhancement model, DeepFilterNet, was applied through two processing strategies: discrete-channel enhancement and a novel Center Enhanced Stereo (CES) method. These were compared to SVT’s existing FFmpeg-based Dialogue Enhance (DE) solution through both objective and subjective evaluations. Objective analysis was performed using non-intrusive metrics Non-Intrusive Speech Quality Assessment (NISQA) and Deep Noise Supression Mean Opinion Score (DNSMOS), while subjective assessments involved over 1,000 SVT Play users rating paired clips across diverse genres. Results indicate that CES consistently improves speech clarity without compromising background audio quality. These findings demonstrate the feasibility of integrating deep learning models into existing streaming pipelines, offering meaningful improvements in accessibility and user experience.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Openalex Percentile: Top 43%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.