Data cleaning and refinement for code related AI systems

• 主要作者: Tay, Arron Hong Yi
• 其他作者: Liu Yang
• 格式: Final Year Project
• 語言: English
• 出版: Nanyang Technological University 2023
• 主題: Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
• 在線閱讀: https://hdl.handle.net/10356/166197

This final-year project will cover data cleaning and refinement to improve the quality of data for various natural language processing (NLP) projects, such as code clone detection and code-to-text conversion. The project will focus on using the PyTorch library to train a masked language model to det...