Robust prompt optimization for large language models against distribution shifts

• Main Authors: LI, Moxin, WANG, Wenjie, FENG, Fuli, CAO, Yixin, ZHANG, Jizhi, CHUA, Tat-Seng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Language model; Language processing; Natural language; Optimizations; Optimization framework; Artificial Intelligence and Robotics; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/8393; https://ink.library.smu.edu.sg/context/sis_research/article/9396/viewcontent/2023.emnlp_main.95.pdf
• Institution: Singapore Management University

Large Language Model (LLM) has demonstrated significant ability in various Natural Language Processing tasks. However, their effectiveness is highly dependent on the phrasing of the task prompt, leading to research on automatic prompt optimization using labeled task data. We reveal that these prompt...