The devil is in the tails: How long-tailed code distributions impact large language models

• المؤلفون الرئيسيون: ZHOU, Xin, KIM, Kisub, XU, Bowen, LIU, Jiakun, HAN, DongGyun, LO, David
• التنسيق: text
• اللغة: English
• منشور في: Institutional Knowledge at Singapore Management University 2023
• الموضوعات: Code distributions; Data distribution; Data properties; Data sample; Engineering tasks; Language model; Learning Based Models; Long-tailed distributions; Number of class; Property; Databases and Information Systems; Software Engineering
• الوصول للمادة أونلاين: https://ink.library.smu.edu.sg/sis_research/8568; https://ink.library.smu.edu.sg/context/sis_research/article/9571/viewcontent/The_devil_is_in_the_tails.pdf

Learning-based techniques, especially advanced Large Language Models (LLMs) for code, have gained considerable popularity in various software engineering (SE) tasks. However, most existing works focus on designing better learning-based models and pay less attention to the properties of datasets. Lea...