Just adjust one prompt: Enhancing in-context dialogue scoring via constructing the optimal subgraph of demonstrations and prompts

• Main Authors: PU, Jiashu, CHENG, Ling, FAN, Lu, LV, Tangjie, ZHANG, Rongsheng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Chatbots; Context learning; Dialogue evaluation; Evaluation methods; In contexts; Language model; Artificial Intelligence and Robotics; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/8751; https://ink.library.smu.edu.sg/context/sis_research/article/9754/viewcontent/2023.emnlp_main.590_pvoa.pdf
• Institution: Singapore Management University

The use of modern Large Language Models (LLMs) as chatbots still has some problems such as hallucinations and lack of empathy. Identifying these issues can help improve chatbot performance. The community has been continually iterating on reference-free dialogue evaluation methods based on large lang...