Investigating statistical and spatial loss functions for geometry-aware unsupervised virtual microphone estimation in multi-source environments

Purpose Small-scale devices often provide too few microphones for effective array processing. This study investigates geometry-aware unsupervised loss functions for a neural network-based virtual microphone estimator (NN-VME), aiming to generate virtual microphone (VM) signals without ground-truth recordings at VM positions. Design/methodology/approach Known array geometry is used to construct training constraints. Alongside a previously proposed loss that maximizes linear correlation between estimated VM signals and recordings from other channels, a new loss based on the time difference of arrival (TDOA) of each source is introduced. The losses are compared on simulated multi-source LibriSpeech data, and the generated VM signals are evaluated with multiple beamformers. Findings The correlation-based method generates high-quality VM signals and improves beamforming performance on CHiME-4. The LibriSpeech experiments demonstrate the effectiveness of geometry-aware unsupervised NN-VME under multi-source conditions and show that the generated VM signals can support different beamforming methods. Research limitations/implications The framework assumes known array geometry, and correlation- and TDOA-based constraints may become less reliable under highly reverberant conditions. Future work should improve robustness in diverse real-world environments. Originality/value This study systematically compares geometry-aware unsupervised NN-VME losses across tasks, introduces a TDOA-based constraint for multi-source target speech extraction, and evaluates the applicability of estimated VM signals across beamformers.

Authors

Institutions

Publication Details

Journal
APSIPA Transactions on Signal and Information Processing
Published
2026-10-24
DOI
https://doi.org/10.1108/atsip-12-2025-0114
Primary Topic
Speech and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Investigating statistical and spatial loss functions for geometry-aware unsupervised virtual microphone estimation in multi-source environments

Tomoki Toda, Jiachen Wang
APSIPA Transactions on Signal and Information Processing
Speech and Audio Processing
article

Investigating statistical and spatial loss functions for geometry-aware unsupervised virtual microphone estimation in multi-source environments

Tomoki Toda, Jiachen Wang
article en

Abstract

Purpose Small-scale devices often provide too few microphones for effective array processing. This study investigates geometry-aware unsupervised loss functions for a neural network-based virtual microphone estimator (NN-VME), aiming to generate virtual microphone (VM) signals without ground-truth recordings at VM positions. Design/methodology/approach Known array geometry is used to construct training constraints. Alongside a previously proposed loss that maximizes linear correlation between estimated VM signals and recordings from other channels, a new loss based on the time difference of arrival (TDOA) of each source is introduced. The losses are compared on simulated multi-source LibriSpeech data, and the generated VM signals are evaluated with multiple beamformers. Findings The correlation-based method generates high-quality VM signals and improves beamforming performance on CHiME-4. The LibriSpeech experiments demonstrate the effectiveness of geometry-aware unsupervised NN-VME under multi-source conditions and show that the generated VM signals can support different beamforming methods. Research limitations/implications The framework assumes known array geometry, and correlation- and TDOA-based constraints may become less reliable under highly reverberant conditions. Future work should improve robustness in diverse real-world environments. Originality/value This study systematically compares geometry-aware unsupervised NN-VME losses across tasks, introduces a TDOA-based constraint for multi-source target speech extraction, and evaluates the applicability of estimated VM signals across beamformers.

APSIPA Transactions on Signal and Information ProcessingVol. 15(1)
Nagoya University (JP)
Openalex Percentile: Top 12%
Speech and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon