Generating personalized dialogue via multi-task meta-learning

Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are readily available. To address these practical limitations, we...

Full description

Saved in:
Bibliographic Details
Main Authors: Lee, Jing Yang, Lee, Kong Aik, Gan, Woon-Seng
Other Authors: School of Electrical and Electronic Engineering
Format: Conference or Workshop Item
Language:English
Published: 2021
Subjects:
Online Access:https://semdial2021.ling.uni-potsdam.de/assets/semdial2021_potsdial_full_proceedings.pdf
https://hdl.handle.net/10356/153442
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-153442
record_format dspace
spelling sg-ntu-dr.10356-1534422021-12-03T03:42:06Z Generating personalized dialogue via multi-task meta-learning Lee, Jing Yang Lee, Kong Aik Gan, Woon-Seng School of Electrical and Electronic Engineering 25th Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL 2021) Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Multi-Task Meta-Learning Personalized Dialogue Generation Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are readily available. To address these practical limitations, we propose a novel multi-task meta-learning approach which involves training a model to adapt to new personas without relying on a large corpus, or on any predefined persona information. Instead, the model is tasked with generating personalized responses based on only the dialogue context. Unlike prior work, our approach leverages on the provided persona information only during training via the introduction of an auxiliary persona reconstruction task. In this paper, we introduce 2 frameworks that adopt the proposed multi-task meta-learning approach: the Multi-Task MetaLearning (MTML) framework, and the Alternating Multi-Task Meta-Learning (AMTML) framework. Experimental results show that utilizing MTML and AMTML results in dialogue responses with greater persona consistency. Published version 2021-12-03T03:39:29Z 2021-12-03T03:39:29Z 2021 Conference Paper Lee, J. Y., Lee, K. A. & Gan, W. (2021). Generating personalized dialogue via multi-task meta-learning. 25th Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL 2021), 88-97. 2308-2275 https://semdial2021.ling.uni-potsdam.de/assets/semdial2021_potsdial_full_proceedings.pdf https://hdl.handle.net/10356/153442 88 97 en © 2021 The Author(s) (published by University of Potsdam). This is an open-access article distributed under the terms of the Creative Commons Attribution License. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Multi-Task Meta-Learning
Personalized Dialogue Generation
spellingShingle Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Multi-Task Meta-Learning
Personalized Dialogue Generation
Lee, Jing Yang
Lee, Kong Aik
Gan, Woon-Seng
Generating personalized dialogue via multi-task meta-learning
description Conventional approaches to personalized dialogue generation typically require a large corpus, as well as predefined persona information. However, in a real-world setting, neither a large corpus of training data nor persona information are readily available. To address these practical limitations, we propose a novel multi-task meta-learning approach which involves training a model to adapt to new personas without relying on a large corpus, or on any predefined persona information. Instead, the model is tasked with generating personalized responses based on only the dialogue context. Unlike prior work, our approach leverages on the provided persona information only during training via the introduction of an auxiliary persona reconstruction task. In this paper, we introduce 2 frameworks that adopt the proposed multi-task meta-learning approach: the Multi-Task MetaLearning (MTML) framework, and the Alternating Multi-Task Meta-Learning (AMTML) framework. Experimental results show that utilizing MTML and AMTML results in dialogue responses with greater persona consistency.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Lee, Jing Yang
Lee, Kong Aik
Gan, Woon-Seng
format Conference or Workshop Item
author Lee, Jing Yang
Lee, Kong Aik
Gan, Woon-Seng
author_sort Lee, Jing Yang
title Generating personalized dialogue via multi-task meta-learning
title_short Generating personalized dialogue via multi-task meta-learning
title_full Generating personalized dialogue via multi-task meta-learning
title_fullStr Generating personalized dialogue via multi-task meta-learning
title_full_unstemmed Generating personalized dialogue via multi-task meta-learning
title_sort generating personalized dialogue via multi-task meta-learning
publishDate 2021
url https://semdial2021.ling.uni-potsdam.de/assets/semdial2021_potsdial_full_proceedings.pdf
https://hdl.handle.net/10356/153442
_version_ 1718368039364198400