Self-distillation for randomized neural networks

• المؤلفون الرئيسيون: Hu, Minghui, Gao, Ruobin, Suganthan, Ponnuthurai Nagaratnam
• مؤلفون آخرون: School of Electrical and Electronic Engineering
• التنسيق: مقال
• اللغة: English
• منشور في: 2024
• الموضوعات: Engineering; Knowledge distillation; Random vector functional link
• الوصول للمادة أونلاين: https://hdl.handle.net/10356/174318

Knowledge distillation (KD) is a conventional method in the field of deep learning that enables the transfer of dark knowledge from a teacher model to a student model, consequently improving the performance of the student model. In randomized neural networks, due to the simple topology of network ar...