STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents
Equipping a conversational search engine with strategies regarding when to ask clarification questions is becoming increasingly important across various domains. Attributing to the context understanding capability of LLMs and their access to domain-specific sources of knowledge, LLM-based clarificat...
Saved in:
Main Authors: | , , , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2024
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9234 https://ink.library.smu.edu.sg/context/sis_research/article/10234/viewcontent/2024.findings_acl.632.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-10234 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-102342024-09-02T06:50:10Z STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents CHEN, Yue HUANG, Chen DENG, Yang LEI, Wenqiang JIN, Dingnan LIU, Jia CHUA, Tat-Seng Equipping a conversational search engine with strategies regarding when to ask clarification questions is becoming increasingly important across various domains. Attributing to the context understanding capability of LLMs and their access to domain-specific sources of knowledge, LLM-based clarification strategies feature rapid transfer to various domains in a posthoc manner. However, they still struggle to deliver promising performance on unseen domains, struggling to achieve effective domain transferability. We take the first step to investigate this issue and existing methods tend to produce one-size-fits-all strategies across diverse domains, limiting their search effectiveness. In response, we introduce a novel method, called STYLE, to achieve effective domain transferability. Our experimental results indicate that STYLE bears strong domain transferability, resulting in an average search performance improvement of ∼10% on four unseen domains. 2024-08-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/9234 https://ink.library.smu.edu.sg/context/sis_research/article/10234/viewcontent/2024.findings_acl.632.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Databases and Information Systems Programming Languages and Compilers |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Databases and Information Systems Programming Languages and Compilers |
spellingShingle |
Databases and Information Systems Programming Languages and Compilers CHEN, Yue HUANG, Chen DENG, Yang LEI, Wenqiang JIN, Dingnan LIU, Jia CHUA, Tat-Seng STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents |
description |
Equipping a conversational search engine with strategies regarding when to ask clarification questions is becoming increasingly important across various domains. Attributing to the context understanding capability of LLMs and their access to domain-specific sources of knowledge, LLM-based clarification strategies feature rapid transfer to various domains in a posthoc manner. However, they still struggle to deliver promising performance on unseen domains, struggling to achieve effective domain transferability. We take the first step to investigate this issue and existing methods tend to produce one-size-fits-all strategies across diverse domains, limiting their search effectiveness. In response, we introduce a novel method, called STYLE, to achieve effective domain transferability. Our experimental results indicate that STYLE bears strong domain transferability, resulting in an average search performance improvement of ∼10% on four unseen domains. |
format |
text |
author |
CHEN, Yue HUANG, Chen DENG, Yang LEI, Wenqiang JIN, Dingnan LIU, Jia CHUA, Tat-Seng |
author_facet |
CHEN, Yue HUANG, Chen DENG, Yang LEI, Wenqiang JIN, Dingnan LIU, Jia CHUA, Tat-Seng |
author_sort |
CHEN, Yue |
title |
STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents |
title_short |
STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents |
title_full |
STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents |
title_fullStr |
STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents |
title_full_unstemmed |
STYLE: Improving domain transferability of asking clarification questions in large language model powered conversational agents |
title_sort |
style: improving domain transferability of asking clarification questions in large language model powered conversational agents |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2024 |
url |
https://ink.library.smu.edu.sg/sis_research/9234 https://ink.library.smu.edu.sg/context/sis_research/article/10234/viewcontent/2024.findings_acl.632.pdf |
_version_ |
1814047840218906624 |