Prompt sensitivity of transformer variants for text classification

• 主要作者: Ong, Li Han
• 其他作者: Wang Wenya
• 格式: Final Year Project
• 語言: English
• 出版: Nanyang Technological University 2024
• 主題: Computer and Information Science; Machine learning; Classification; Model sensitivity; Large language models
• 在線閱讀: https://hdl.handle.net/10356/181519

This study investigates the sensitivity of various Transformer model architectures, encoder-only (BERT), decoder-only (GPT-2), and encoder-decoder (T5), in response to various types of prompt modifications on text classification tasks. By leveraging a fine-tuning approach, the models were evaluated...