Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training
Quentin Le Tellier, Albert Rilliard, Olivier Perrotin, Marc Evrard
Abstract
Vocal intensity conversion renders a recorded utterance at a different vocal intensity, rather than simply scaling its amplitude, while preserving its content and speaker identity. Existing systems control intensity through a reference utterance or a few discrete categories. Instead, we control the conversion with any target sound pressure level (SPL) on a continuous dB scale. A lightweight converter, trained as a conditional cycle-consistent GAN without parallel data, transforms the features of a frozen speech encoder, from which a pretrained vocoder resynthesizes the speech. We compare three representations, log-mel spectrograms, WavLM, and SpeechTokenizer, and introduce an objective protocol that measures the achieved intensity change against the target one on a calibrated corpus. With WavLM, the converter achieves a measured 83% of the target change in intensity and also shifts the fundamental frequency. A perceptual evaluation confirms that perceived vocal intensity increases with the target level on amplitude-normalized stimuli.
Create a lesson
Related papers
OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation
Fu-An Chao, Bi-Cheng Yan, Berlin Chen
OpenSVBench: Diagnosing Speaker Verification Generalization Across Deployment Scenarios
Qituan Shangguan, Bosen Xu, Shuai Wang
Revisiting Accent Classification with DistilHuBERT: Speaker-Disjoint Evaluation and Cross-Corpus Generalization
Xu He, Homayoon Beigi
Does Financial Speech Need Continual Learning Regularization? A Study of EWC and mini-KFAC on Earnings Call ASR
Thai Quoc On, Homayoon Beigi
Frontend-Assisted Large Audio-Language Models for SLT2026 SmartGlasses Challenge
Yushi Wang, Zeyan Song, Xiaobin Rong et al.
E3-System: Expressive EmoData, Explicitly Controllable, Easy-to-Use TTS
Yiqiao Huang, Xiaolong Lin, Zhenpeng Zhan et al.