Assessing generalizability of CodeBERT

• Main Authors: ZHOU, Xin, HAN, DongGyun, LO, David
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: pre-trained model; generalizability; CodeBERT; Databases and Information Systems; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/6854; https://ink.library.smu.edu.sg/context/sis_research/article/7857/viewcontent/288200a425.pdf
• Institution: Singapore Management University

Pre-trained models like BERT have achieved strong improvements on many natural language processing (NLP) tasks, showing their great generalizability. The success of pre-trained models in NLP inspires pre-trained models for programming language. Recently, CodeBERT, a model for both natural language (...