Language-Oriented Semantic Modeling for Target Language Extraction
Mehmet Sinan Yıldırım, Ke Zhang, Shuai Wang, Haizhou Li
Abstract
Target Language Extraction (TLE) aims to isolate speech in a target language from multilingual mixtures. Existing approaches primarily rely on acoustic modeling with language identity labels, which provide only coarse categorical guidance. In this work, we propose a language-oriented semantic modeling framework that augments acoustic extraction with language-specific semantic representations. A pre-trained speech semantic model is adapted via language-aware prompt conditioning and parameter-efficient fine-tuning to generate target-language-focused semantic representations from the mixture. These capture high-level semantic structure of the acoustics and they are integrated into the extraction model to provide structured semantic guidance beyond identity labels. Experiments on the CommonVoiceMix dataset show that incorporating semantic representations consistently improves over acoustic-only baselines, achieving up to 1.16 dB SI-SDR gain.
Create a lesson
Related papers
Represented but misread: Post-training changes how language models read out what they represent
Jochen Laubrock
AutoMaster: Autonomous Post-Training by Making the Same Model a Better Teacher
Guoxin Chen, Shuang Sun, Fanzhe Meng et al.
Multimodal Error Detection in Chest X-ray Reports: A Large Language Model Reading Image Evidence
Yanda Cheng, Bo Wen, Yuhao Lu
MemFolder: Structure-Guided Memory Folding for Efficient Agent Memory Management
Xuyang Liu, Chenwen Lu, Junxi Wang et al.
Beam Model Technical Report
Reflection Team, Adam Abdulhamid, Osama Abuelsorour et al.
One Framework to Diagnose Them All: A Stratified Benchmark for Bengali LLM Hallucination
Asif Shahriyar Sushmit, Shefayat E Shams Adib, Abdullah Al Jubaer Gem et al.