Generating personalized dialogue via multi-task meta-learning
Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are readily available. To address these practical limitations, we...
Saved in:
Main Authors: | , , |
---|---|
Other Authors: | |
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2021
|
Subjects: | |
Online Access: | https://semdial2021.ling.uni-potsdam.de/assets/semdial2021_potsdial_full_proceedings.pdf https://hdl.handle.net/10356/153442 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-153442 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1534422021-12-03T03:42:06Z Generating personalized dialogue via multi-task meta-learning Lee, Jing Yang Lee, Kong Aik Gan, Woon-Seng School of Electrical and Electronic Engineering 25th Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL 2021) Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Multi-Task Meta-Learning Personalized Dialogue Generation Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are readily available. To address these practical limitations, we propose a novel multi-task meta-learning approach which involves training a model to adapt to new personas without relying on a large corpus, or on any predefined persona information. Instead, the model is tasked with generating personalized responses based on only the dialogue context. Unlike prior work, our approach leverages on the provided persona information only during training via the introduction of an auxiliary persona reconstruction task. In this paper, we introduce 2 frameworks that adopt the proposed multi-task meta-learning approach: the Multi-Task MetaLearning (MTML) framework, and the Alternating Multi-Task Meta-Learning (AMTML) framework. Experimental results show that utilizing MTML and AMTML results in dialogue responses with greater persona consistency. Published version 2021-12-03T03:39:29Z 2021-12-03T03:39:29Z 2021 Conference Paper Lee, J. Y., Lee, K. A. & Gan, W. (2021). Generating personalized dialogue via multi-task meta-learning. 25th Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL 2021), 88-97. 2308-2275 https://semdial2021.ling.uni-potsdam.de/assets/semdial2021_potsdial_full_proceedings.pdf https://hdl.handle.net/10356/153442 88 97 en © 2021 The Author(s) (published by University of Potsdam). This is an open-access article distributed under the terms of the Creative Commons Attribution License. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Multi-Task Meta-Learning Personalized Dialogue Generation |
spellingShingle |
Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Multi-Task Meta-Learning Personalized Dialogue Generation Lee, Jing Yang Lee, Kong Aik Gan, Woon-Seng Generating personalized dialogue via multi-task meta-learning |
description |
Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are readily available. To address these practical limitations, we propose a novel
multi-task meta-learning approach which involves training a model to adapt to new personas without relying on a large corpus, or on any predefined persona information. Instead, the model is tasked with generating personalized responses based on only the dialogue context. Unlike prior work, our approach leverages on the provided persona information only during training via the introduction of an auxiliary persona reconstruction task. In this paper, we introduce 2 frameworks that adopt the proposed multi-task
meta-learning approach: the Multi-Task MetaLearning (MTML) framework, and the Alternating Multi-Task Meta-Learning (AMTML) framework. Experimental results show that utilizing MTML and AMTML results in dialogue responses with greater persona consistency. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Lee, Jing Yang Lee, Kong Aik Gan, Woon-Seng |
format |
Conference or Workshop Item |
author |
Lee, Jing Yang Lee, Kong Aik Gan, Woon-Seng |
author_sort |
Lee, Jing Yang |
title |
Generating personalized dialogue via multi-task meta-learning |
title_short |
Generating personalized dialogue via multi-task meta-learning |
title_full |
Generating personalized dialogue via multi-task meta-learning |
title_fullStr |
Generating personalized dialogue via multi-task meta-learning |
title_full_unstemmed |
Generating personalized dialogue via multi-task meta-learning |
title_sort |
generating personalized dialogue via multi-task meta-learning |
publishDate |
2021 |
url |
https://semdial2021.ling.uni-potsdam.de/assets/semdial2021_potsdial_full_proceedings.pdf https://hdl.handle.net/10356/153442 |
_version_ |
1718368039364198400 |