Can identifier splitting improve open-vocabulary language model of code?
Statistical language models on source code have successfully assisted software engineering tasks. However, developers can create or pick arbitrary identifiers when writing source code. Freely chosen identifiers lead to the notorious out-of-vocabulary (OOV) problem that negatively affects model perfo...
Saved in:
Main Authors: | SHI, Jieke, YANG, Zhou, HE, Junda, XU, Bowen, LO, David |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2022
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/7698 https://ink.library.smu.edu.sg/context/sis_research/article/8701/viewcontent/can_identifier.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
Split group codes
by: Ding, C., et al.
Published: (2013) -
Open-vocabulary object detection via debiased curriculum self-training
by: Zhang, Hanlue, et al.
Published: (2024) -
Repeated Exposure to Vocabulary Websites and Academic Vocabulary Retention by University Students in Japan
by: Mirador, Josephine, et al.
Published: (2022) -
Greening large language models of code
by: SHI, Jieke, et al.
Published: (2024) -
On the feasibility of detecting cross-platform code clones via identifier similarity
by: CHENG, Xiao, et al.
Published: (2016)