Can identifier splitting improve open-vocabulary language model of code?

Can identifier splitting improve open-vocabulary language model of code?

Statistical language models on source code have successfully assisted software engineering tasks. However, developers can create or pick arbitrary identifiers when writing source code. Freely chosen identifiers lead to the notorious out-of-vocabulary (OOV) problem that negatively affects model perfo...

Full description

Saved in:
Bibliographic Details
Main Authors: SHI, Jieke, YANG, Zhou, HE, Junda, XU, Bowen, LO, David
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2022
Subjects:
Open vocabulary
Identifier splitting
Language model of code
Software Engineering
Online Access:https://ink.library.smu.edu.sg/sis_research/7698
https://ink.library.smu.edu.sg/context/sis_research/article/8701/viewcontent/can_identifier.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English

Internet

https://ink.library.smu.edu.sg/sis_research/7698
https://ink.library.smu.edu.sg/context/sis_research/article/8701/viewcontent/can_identifier.pdf

Similar Items