Joint learning of answer selection and answer summary generation in community question answering

Joint learning of answer selection and answer summary generation in community question answering

Community question answering (CQA) gains increasing popularity in both academy and industry recently. However, the redundancy and lengthiness issues of crowdsourced answers limit the performance of answer selection and lead to reading difficulties and misunderstandings for community users. To solve...

Full description

Saved in:
Bibliographic Details
Main Authors: DENG, Yang, LAM, Wai, XIE, Yuexiang, CHEN, Daoyuan, LI, Yaliang, YANG, Min, SHEN, Ying
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2020
Subjects:
Community question answering
Joint learning
Question-answer pairs
Summary generation
Text summarization
Databases and Information Systems
Information Security
Online Access:https://ink.library.smu.edu.sg/sis_research/9102
https://ink.library.smu.edu.sg/context/sis_research/article/10105/viewcontent/6266_Article_Text_9491_1_10_20200516.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
Description
Summary:Community question answering (CQA) gains increasing popularity in both academy and industry recently. However, the redundancy and lengthiness issues of crowdsourced answers limit the performance of answer selection and lead to reading difficulties and misunderstandings for community users. To solve these problems, we tackle the tasks of answer selection and answer summary generation in CQA with a novel joint learning model. Specifically, we design a question-driven pointer-generator network, which exploits the correlation information between question-Answer pairs to aid in attending the essential information when generating answer summaries. Meanwhile, we leverage the answer summaries to alleviate noise in original lengthy answers when ranking the relevancy degrees of question-Answer pairs. In addition, we construct a new large-scale CQA corpus, WikiHowQA, which contains long answers for answer selection as well as reference summaries for answer summarization. The experimental results show that the joint learning method can effectively address the answer redundancy issue in CQA and achieves state-ofthe-art results on both answer selection and text summarization tasks. Furthermore, the proposed model is shown to be of great transferring ability and applicability for resource-poor CQA tasks, which lack of reference answer summaries.

Similar Items