Does Financial Speech Need Continual Learning Regularization? A Study of EWC and mini-KFAC on Earnings Call ASR
Thai Quoc On, Homayoon Beigi
Abstract
Earnings call transcription presents a realistic continual learning scenario where Automatic Speech Recognition (ASR) systems are updated with new recordings but risk catastrophic forgetting of previously learned financial speech patterns. Adapting Whisper-small from a general-domain speech corpus to the Earnings22 benchmark reveals the opposite: all evaluated methods exhibit improvement on held-out financial speech from the same domain during adaptation rather than forgetting. This task complementarity makes regularization counterproductive. Nevertheless, when regularization is warranted, a layer-wise mini-Kronecker-Factored Approximate Curvature (mini-KFAC) approximation seems to achieve lower word error rates (WERs) and more stable optimization than standard diagonal Elastic Weight Consolidation (EWC). The results suggest that task complementarity should be assessed before applying continual learning constraints, and prefer mini-KFAC EWC over diagonal EWC when needed.
Create a lesson
Related papers
OpenPA: Forced-alignment-free Multi-granular Pronunciation Assessment with Mixed-transcript Adaptation
Fu-An Chao, Bi-Cheng Yan, Berlin Chen
OpenSVBench: Diagnosing Speaker Verification Generalization Across Deployment Scenarios
Qituan Shangguan, Bosen Xu, Shuai Wang
Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training
Quentin Le Tellier, Albert Rilliard, Olivier Perrotin et al.
Revisiting Accent Classification with DistilHuBERT: Speaker-Disjoint Evaluation and Cross-Corpus Generalization
Xu He, Homayoon Beigi
Frontend-Assisted Large Audio-Language Models for SLT2026 SmartGlasses Challenge
Yushi Wang, Zeyan Song, Xiaobin Rong et al.
E3-System: Expressive EmoData, Explicitly Controllable, Easy-to-Use TTS
Yiqiao Huang, Xiaolong Lin, Zhenpeng Zhan et al.