On the transferability of pre-trained language models for low-resource programming languages

• Main Authors: CHEN, Fuxiang, FARD, Fatemeh H., LO, David, BRYKSIN, Timofey
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: Pre-trained language models; Low-resource languages; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/7693; https://ink.library.smu.edu.sg/context/sis_research/article/8696/viewcontent/On_the_transfer.pdf
• Institution: Singapore Management University

A recent study by Ahmed and Devanbu reported that using a corpus of code written in multilingual datasets to fine-tune multilingual Pre-trained Language Models (PLMs) achieves higher performance as opposed to using a corpus of code written in just one programming language. However, no analysis was m...