Pre-training model based on the transfer learning in natural language processing

• Main Author: Tang, Jiayi
• Other Authors: Mao Kezhi
• Format: Theses and Dissertations
• Language: English
• Published: 2019
• Subjects: Engineering::Electrical and electronic engineering
• Online Access: http://hdl.handle.net/10356/78688
• Institution: Nanyang Technological University

Transfer learning is to apply knowledge or patterns learned in a particular field or task to different but related areas or problem. It is very prominent in terms of scarcity of data and heterogeneity of domain distribution. In the field of natural language processing, transfer learning is embodied...