Continual learning optimizations for auto-regressive decoder of multilingual ASR systems

• المؤلفون الرئيسيون: Kwok, Chin Yuen, Yip, Jia Qi, Chng, Eng Siong
• مؤلفون آخرون: College of Computing and Data Science
• التنسيق: Conference or Workshop Item
• اللغة: English
• منشور في: 2024
• الموضوعات: Computer and Information Science; Continual learning; Language-agnostic
• الوصول للمادة أونلاين: https://hdl.handle.net/10356/180315; http://arxiv.org/abs/2407.03645v3; https://www.isca-archive.org/interspeech_2024/index.html

Continual Learning (CL) involves fine-tuning pre-trained models with new data while maintaining the performance on the pre-trained data. This is particularly relevant for expanding multilingual ASR (MASR) capabilities. However, existing CL methods, mainly designed for computer vision and reinforc...