Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge

Answer selection, which is involved in many natural language processing applications, such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typically suffer from the issues of ignoring diverse real-world background knowledge....

Full description

Saved in:
Bibliographic Details
Main Authors: DENG, Yang, XIE, Yuexiang, LI, Yaliang, YANG, Min, LAM, Wai, SHEN, Ying
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2022
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/9087
https://ink.library.smu.edu.sg/context/sis_research/article/10090/viewcontent/3457533.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-10090
record_format dspace
spelling sg-smu-ink.sis_research-100902024-08-01T15:12:28Z Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge DENG, Yang XIE, Yuexiang LI, Yaliang YANG, Min LAM, Wai SHEN, Ying Answer selection, which is involved in many natural language processing applications, such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typically suffer from the issues of ignoring diverse real-world background knowledge. In this article, we extensively investigate approaches to enhancing the answer selection model with external knowledge from knowledge graph (KG). First, we present a context-knowledge interaction learning framework, Knowledge-aware Neural Network, which learns the QA sentence representations by considering a tight interaction with the external knowledge from KG and the textual information. Then, we develop two kinds of knowledge-aware attention mechanism to summarize both the context-based and knowledge-based interactions between questions and answers. To handle the diversity and complexity of KG information, we further propose a Contextualized Knowledge-aware Attentive Neural Network, which improves the knowledge representation learning with structure information via a customized Graph Convolutional Network and comprehensively learns context-based and knowledge-based sentence representation via the multi-view knowledge-aware attention mechanism. We evaluate our method on four widely used benchmark QA datasets, including WikiQA, TREC QA, InsuranceQA, and Yahoo QA. Results verify the benefits of incorporating external knowledge from KG and show the robust superiority and extensive applicability of our method. 2022-01-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/9087 info:doi/10.1145/3457533 https://ink.library.smu.edu.sg/context/sis_research/article/10090/viewcontent/3457533.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Answer selection knowledge graph attention mechanism graph convolutional network Databases and Information Systems OS and Networks
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Answer selection
knowledge graph
attention mechanism
graph convolutional network
Databases and Information Systems
OS and Networks
spellingShingle Answer selection
knowledge graph
attention mechanism
graph convolutional network
Databases and Information Systems
OS and Networks
DENG, Yang
XIE, Yuexiang
LI, Yaliang
YANG, Min
LAM, Wai
SHEN, Ying
Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge
description Answer selection, which is involved in many natural language processing applications, such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typically suffer from the issues of ignoring diverse real-world background knowledge. In this article, we extensively investigate approaches to enhancing the answer selection model with external knowledge from knowledge graph (KG). First, we present a context-knowledge interaction learning framework, Knowledge-aware Neural Network, which learns the QA sentence representations by considering a tight interaction with the external knowledge from KG and the textual information. Then, we develop two kinds of knowledge-aware attention mechanism to summarize both the context-based and knowledge-based interactions between questions and answers. To handle the diversity and complexity of KG information, we further propose a Contextualized Knowledge-aware Attentive Neural Network, which improves the knowledge representation learning with structure information via a customized Graph Convolutional Network and comprehensively learns context-based and knowledge-based sentence representation via the multi-view knowledge-aware attention mechanism. We evaluate our method on four widely used benchmark QA datasets, including WikiQA, TREC QA, InsuranceQA, and Yahoo QA. Results verify the benefits of incorporating external knowledge from KG and show the robust superiority and extensive applicability of our method.
format text
author DENG, Yang
XIE, Yuexiang
LI, Yaliang
YANG, Min
LAM, Wai
SHEN, Ying
author_facet DENG, Yang
XIE, Yuexiang
LI, Yaliang
YANG, Min
LAM, Wai
SHEN, Ying
author_sort DENG, Yang
title Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge
title_short Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge
title_full Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge
title_fullStr Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge
title_full_unstemmed Contextualized knowledge-aware attentive neural network: Enhancing answer selection with knowledge
title_sort contextualized knowledge-aware attentive neural network: enhancing answer selection with knowledge
publisher Institutional Knowledge at Singapore Management University
publishDate 2022
url https://ink.library.smu.edu.sg/sis_research/9087
https://ink.library.smu.edu.sg/context/sis_research/article/10090/viewcontent/3457533.pdf
_version_ 1814047727815753728