HybridSB-MoE: Dual-Domain Schrödinger Bridges with Scene-Adaptive Expert Routing for Speech Enhancement
Zhengyi Lu, Aswini Sivakumar, Jie Hu, Yao Qiang
Abstract
Generative speech enhancement faces three gaps: spectral models capture harmonic structure but often disrupt phase, waveform models preserve phase but miss harmonics, and Schrödinger Bridges (SB) shorten transport from noise to clean speech but leave inference cost only loosely tied to training. We propose HybridSB-MoE, a dual-domain framework that fills these gaps through three contributions unified by a single asymmetric design principle. (i) Asymmetric uncertainty fusion: The spectral path captures epistemic uncertainty via expert disagreement, while the waveform bridge models aleatoric variance through stochastic dynamics. We fuse them asymmetrically, allowing the mixing weight to adapt to distinct error regimes rather than average predictions. (ii) Heterogeneous MoE with top-k=2 routing across five distinct architectural archetypes, where architectural diversity makes the epistemic signal indicate which inductive bias fails rather than small perturbations among similar experts. (iii) Discretization bound (Theorem 1): path-consistency and trajectory regularizers together bound the K-step bridge sampling error in 2-Wasserstein distance at rate K-alpha, making small-K inference an objective-level guarantee rather than an empirical claim. On VoiceBank+DEMAND, HybridSB-MoE outperforms diffusion- and SB-based baselines at their step budgets while remaining competitive with consistency-distilled few-step methods.
Create a lesson
Related papers
FRAUDSkill: Structured Frozen-Weight Skill Optimization for Audio Anti-Fraud Detection
Chengxian Hu, Zhiming Ma, Mingjun Pan et al.
TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection
Huiyuan Liu, Zhiming Ma, Yanxing Liu et al.
Multi-Teacher Distillation for Cross-Domain Streaming Electrolaryngeal Speech Encoding
Benedikt Mayrhofer, Enrique Orozco Olivares, Franz Pernkopf et al.
Beyond EER: Multi-Dimensional Evaluation of Information Leakage in Speaker De-Identification
Seungmin Seo, Oleg Aulov, P. Jonathon Phillips et al.
TTM-Bench: A Framework for Text-to-Music System Performance Benchmarking
Giorgia Adorni, Michela Papandrea, Battista Rimoldi et al.
VoiceTrace: A Benchmark and Retrieval Framework for Who-Said-What Speech Retrieval
Aaron Yee, Fengjie Lu, Jiarui Hai et al.