Prompt sensitivity of transformer variants for text classification

• Main Author: Ong, Li Han
• Other Authors: Wang Wenya
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; Machine learning; Classification; Model sensitivity; Large language models
• Online Access: https://hdl.handle.net/10356/181519
• Institution: Nanyang Technological University

This study investigates the sensitivity of various Transformer model architectures, encoder-only (BERT), decoder-only (GPT-2), and encoder-decoder (T5), in response to various types of prompt modifications on text classification tasks. By leveraging a fine-tuning approach, the models were evaluated...