GAMW: Generation-Aware Mel-Domain Watermarking for TTS Traceability
Yihang Zhang, Weicai Yan, Qifei Zhang, Yangyang Wu, Tao Jin
Abstract
As text-to-speech (TTS) systems continue to advance, provenance tracking and security verification of synthesized speech have become increasingly important. Audio watermarking provides active provenance by embedding imperceptible, machine-recoverable information into speech. However, existing post-hoc methods typically modify the waveform after synthesis, leaving the watermark vulnerable to compound perturbations. To address this limitation, we propose GAMW, a watermark injection framework integrated into the TTS generation process. Before waveform synthesis, GAMW embeds a content-adaptive multi-bit watermark residual into the generated representation, and its decoding objective combines focal modulation with dynamic per-bit weighting. We train and evaluate GAMW separately on two TTS backbones. With a 16-bit payload, GAMW improves decoding accuracy over the strongest baseline by 9.2 and 23.5 percentage points under individual and compound perturbations, respectively, while maintaining competitive speech quality. Reliable clean-speech decoding is also retained at higher payloads. Code is available at https://github.com/ZConJugaTe/GAMW.
Create a lesson
Related papers
How Language-Independent Are Emotional Attributes? A Study on Training Data Scaling and Cross-Lingual Generalization
Dániel Halmai, Gábor Gosztolya
Learning Where to Split: Dynamic Band Splitting for Audio Source Separation
Bingzhe Zhang, Kai Li, Xiaolin Hu
Transfer Learning for Rhythm Game Chart Generation from Music Transcription and Across Games
Sojeong An, Nathan Pruyne, Chris Donahue et al.
Explore This! Beat and Downbeat Tracking From a Learned Tatum Grid
Robert Kihlborg, André Holzapfel, Jan Schlüter
Training a Compact, Strong, and Realistic Text-to-Speech Model
Runyuan Cai, Yu Lin, Yiming Wang et al.
AlignAudio: A Unified Dual-Alignment Framework for Noise-Robust Speech-Conditioned Generation
Yixuan Li, Xuenan Xu, Zeyu Xie et al.