Architectural Asymmetry and Orientation-Averaged Calibration for Joint Acoustic Echo Cancellation and Beamforming in Smart Glasses

Modern hands-free and wearable communication devices employ multiple microphones and loudspeakers, leading to the joint presence of acoustic echo, background noise, and desired speech signals. While acoustic echo cancellation (AEC) and beamforming are commonly combined to address this challenge, existing architectures face a trade-off between computational complexity, stability, and adaptability. In particular, adaptive beamforming approaches require repeated estimation and inversion of covariance matrices, incurring high computational cost and introducing potential sensitivity to time-varying conditions. Conversely, fixed beamformers reduce online complexity and improve stability, but their performance can degrade when the acoustic scene differs from the calibration condition. In this work, we investigate low-complexity AEC–beamforming architectures that combine fixed minimum-variance distortionless response (MVDR) beamforming with adaptive AEC. Since the ordering of these stages yields two inequivalent architectures, we evaluate two configurations: AEC followed by beamforming (AEC-BF) and beamforming followed by AEC (BF-AEC). To reduce dependence on a single head pose in wearable devices, we use an offline orientation-averaged calibration strategy in which the undesired-signal covariance matrix and, when required, the relative echo transfer functions (RETFs) are estimated from calibration measurements averaged across multiple head orientations. The proposed methods are evaluated using real-device recordings from a six-microphone wearable device. The results show a clear architectural asymmetry: the fixed BF-AEC configuration achieves the highest average echo return loss enhancement (ERLE) and perceptual evaluation of speech quality (PESQ), with substantially lower online complexity than the fully adaptive baseline, whereas the fixed AEC-BF configuration provides a higher signal-to-distortion ratio (SDR) in the evaluated experiment. Additional calibration experiments show that orientation-averaged RETF calibration provides partial generalization across the measured head orientations, but also that the RETFs are not fully orientation-invariant. Overall, the results indicate that fixed BF-AEC provides a favorable trade-off between echo suppression, stability, and online complexity under the evaluated real-recording conditions.

Authors

Institutions

Publication Details

Journal
Symmetry
Published
2026-06-24
DOI
https://doi.org/10.3390/sym18071075
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Architectural Asymmetry and Orientation-Averaged Calibration for Joint Acoustic Echo Cancellation and Beamforming in Smart Glasses

Anat Tyomkin, Israel Cohen, Ariel J. Frank
Symmetry
Speech and Audio Processing
article

Architectural Asymmetry and Orientation-Averaged Calibration for Joint Acoustic Echo Cancellation and Beamforming in Smart Glasses

Anat Tyomkin, Israel Cohen, Ariel J. Frank
article en

Abstract

Modern hands-free and wearable communication devices employ multiple microphones and loudspeakers, leading to the joint presence of acoustic echo, background noise, and desired speech signals. While acoustic echo cancellation (AEC) and beamforming are commonly combined to address this challenge, existing architectures face a trade-off between computational complexity, stability, and adaptability. In particular, adaptive beamforming approaches require repeated estimation and inversion of covariance matrices, incurring high computational cost and introducing potential sensitivity to time-varying conditions. Conversely, fixed beamformers reduce online complexity and improve stability, but their performance can degrade when the acoustic scene differs from the calibration condition. In this work, we investigate low-complexity AEC–beamforming architectures that combine fixed minimum-variance distortionless response (MVDR) beamforming with adaptive AEC. Since the ordering of these stages yields two inequivalent architectures, we evaluate two configurations: AEC followed by beamforming (AEC-BF) and beamforming followed by AEC (BF-AEC). To reduce dependence on a single head pose in wearable devices, we use an offline orientation-averaged calibration strategy in which the undesired-signal covariance matrix and, when required, the relative echo transfer functions (RETFs) are estimated from calibration measurements averaged across multiple head orientations. The proposed methods are evaluated using real-device recordings from a six-microphone wearable device. The results show a clear architectural asymmetry: the fixed BF-AEC configuration achieves the highest average echo return loss enhancement (ERLE) and perceptual evaluation of speech quality (PESQ), with substantially lower online complexity than the fully adaptive baseline, whereas the fixed AEC-BF configuration provides a higher signal-to-distortion ratio (SDR) in the evaluated experiment. Additional calibration experiments show that orientation-averaged RETF calibration provides partial generalization across the measured head orientations, but also that the RETFs are not fully orientation-invariant. Overall, the results indicate that fixed BF-AEC provides a favorable trade-off between echo suppression, stability, and online complexity under the evaluated real-recording conditions.

SymmetryVol. 18(7)
Technion – Israel Institute of Technology (IL)
Israel Science Foundation
Openalex Percentile: Top 5%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.