Spatially-Guided Speaker Extraction Based on Relative Position Cues
Aviad Eisenberg, Shlomo E. Chazan, Sharon Gannot
Abstract
We present a multi-channel target speaker extraction (TSE) framework that is guided by relative spatial cues rather than explicit speaker-dependent references, such as clean enrollment utterances or precise directions of arrival (DOA). The proposed approach encodes the target speaker through discrete, interpretable relations between concurrent speakers, such as left and right or near and far, referred to as the Relative Position Cue (RPC). This relational conditioning effectively leverages spatial information while avoiding explicit DOA estimation, thereby enabling more robust operation under realistic conditions. We evaluate the proposed method across multiple datasets encompassing diverse acoustic conditions, including directional and diffuse babble noise, varying numbers of microphones, mixtures with different numbers of speakers, and dynamic scenarios involving moving speakers. Experimental results demonstrate that the RPC-based approach consistently achieves strong extraction performance and generalizes well across all tested configurations, establishing it as a practical and interpretable alternative for spatially informed speaker extraction.
Create a lesson
Related papers
TTSonic: A Unified Framework for Composable and Controllable Speech Generation
Zhedong Zhang, Kaiwen Zhou, Junyan Wu et al.
SciPhi-Chat: Training a Spatial Audio Agent for Question Answering, Dialogue, and Tool Use
Gijs Wijngaard, Hannes Gamper, Sebastian Braun
Clean-anchored excess-emission control for CTC adaptation under competing speech
Yuanbo Zhou, Junjie Xiong
PianoBench: Evaluating Musical Perception and Reasoning in Language Models
Louis Bradshaw, Irmak Bukey, Daniel Chenyu Lin et al.
Metadata-Conditioned Audio Transformers for Adaptive Respiratory Sound Classification
George Kontogiannis, Pantelis Tzamalis, Sotiris Nikoletseas
Ananas: A Networked Audio System for Distributed Spatial Audio Applications
Thomas Rushton, Romain Michon, Tanguy Risset