Vibrato Matching for Modulation Control and Blending in Sound Mixtures
Jeremy Hyrkas
Abstract
In sound mixtures of more than one musical source, different vibrato patterns act as a cue that multiple sources are present for both human listeners and source separation algorithms. Matching the vibrato patterns of the signals in the mixture reduces the perception of multiple sources, particularly when the sources play in unison. This work introduces the vibrato matching algorithm, which first suppresses vibrato in a target signal and then transfers vibrato from a source signal to the target. An existing vibrato suppression algorithm is combined with a new algorithm for vibrato transfer, which imparts frequency modulation and amplitude modulation to the harmonics of the target signal, and amplitude modulation onto the spectral envelope of the non-harmonic residual component. Examples demonstrate the algorithm's utility as a vibrato control mechanism and as a tool for blending sound sources. Matching vibrato degrades the performance of source separation algorithms, suggesting a similar degradation in listeners ability to detect the presence of multiple sources.
Create a lesson
Related papers
FRAUDSkill: Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection
Chengxian Hu, Zhiming Ma, Mingjun Pan et al.
TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection
Huiyuan Liu, Zhiming Ma, Yanxing Liu et al.
Multi-Teacher Distillation for Cross-Domain Streaming Electrolaryngeal Speech Encoding
Benedikt Mayrhofer, Enrique Orozco Olivares, Franz Pernkopf et al.
Beyond EER: Multi-Dimensional Evaluation of Information Leakage in Speaker De-Identification
Seungmin Seo, Oleg Aulov, P. Jonathon Phillips et al.
TTM-Bench: A Framework for Text-to-Music System Performance Benchmarking
Giorgia Adorni, Michela Papandrea, Battista Rimoldi et al.
VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval
Aaron Yee, Fengjie Lu, Jiarui Hai et al.