Synergizing Large Language Models and pre-trained smaller models for conversational intent discovery

• Main Authors: LIANG, Jinggui, LIAO, Lizi, FEI, Hao, JIANG, Jing
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Conversational Intent Discovery; CID; Large Language Models; LLMs; Small Language Models; SLMs; Artificial Intelligence and Robotics; Computer Sciences
• Online Access: https://ink.library.smu.edu.sg/sis_research/9698; https://ink.library.smu.edu.sg/context/sis_research/article/10698/viewcontent/2024.findings_acl.840.pdf
• Institution: Singapore Management University

In Conversational Intent Discovery (CID), Small Language Models (SLMs) struggle with overfitting to familiar intents and fail to label newly discovered ones. This issue stems from their limited grasp of semantic nuances and their intrinsically discriminative framework. Therefore, we propose Synergiz...