Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce
Nowadays, it is a heated topic for many industries to build automatic question-answering (QA) systems. A key solution to these QA systems is to retrieve from a QA knowledge base the most similar question of a given question, which can be reformulated as a paraphrase identification (PI) or a natural...
Saved in:
Main Authors: | , , , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2018
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/3964 https://ink.library.smu.edu.sg/context/sis_research/article/4966/viewcontent/p682_yu.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-4966 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-49662018-12-27T01:05:04Z Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce YU, Jianfei QIU, Minghui JIANG, Jing HUANG, Jun SONG, Shuangyong CHU, Wei CHEN, Haiqing Nowadays, it is a heated topic for many industries to build automatic question-answering (QA) systems. A key solution to these QA systems is to retrieve from a QA knowledge base the most similar question of a given question, which can be reformulated as a paraphrase identification (PI) or a natural language inference (NLI) problem. However, most existing models for PI and NLI have at least two problems: They rely on a large amount of labeled data, which is not always available in real scenarios, and they may not be efficient for industrial applications. In this paper, we study transfer learning for the PI and NLI problems, aiming to propose a general framework, which can effectively and efficiently adapt the shared knowledge learned from a resource-rich source domain to a resource-poor target domain. Specifically, since most existing transfer learning methods only focus on learning a shared feature space across domains while ignoring the relationship between the source and target domains, we propose to simultaneously learn shared representations and domain relationships in a unified framework. Furthermore, we propose an efficient and effective hybrid model by combining a sentence encoding-based method and a sentence interaction-based method as our base model. Extensive experiments on both paraphrase identification and natural language inference demonstrate that our base model is efficient and has promising performance compared to the competing models, and our transfer learning method can help to significantly boost the performance. Further analysis shows that the inter-domain and intra-domain relationship captured by our model are insightful. Last but not least, we deploy our transfer learning model for PI into our online chatbot system, which can bring in significant improvements over our existing system. Finally, we launch our new system on the chatbot platform Eva in our E-commerce site AliExpress. 2018-02-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/3964 info:doi/10.1145/3159652.3159685 https://ink.library.smu.edu.sg/context/sis_research/article/4966/viewcontent/p682_yu.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University retrieval-based question answering adversarial training domain relationships learning transfer learning Databases and Information Systems E-Commerce |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
retrieval-based question answering adversarial training domain relationships learning transfer learning Databases and Information Systems E-Commerce |
spellingShingle |
retrieval-based question answering adversarial training domain relationships learning transfer learning Databases and Information Systems E-Commerce YU, Jianfei QIU, Minghui JIANG, Jing HUANG, Jun SONG, Shuangyong CHU, Wei CHEN, Haiqing Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce |
description |
Nowadays, it is a heated topic for many industries to build automatic question-answering (QA) systems. A key solution to these QA systems is to retrieve from a QA knowledge base the most similar question of a given question, which can be reformulated as a paraphrase identification (PI) or a natural language inference (NLI) problem. However, most existing models for PI and NLI have at least two problems: They rely on a large amount of labeled data, which is not always available in real scenarios, and they may not be efficient for industrial applications. In this paper, we study transfer learning for the PI and NLI problems, aiming to propose a general framework, which can effectively and efficiently adapt the shared knowledge learned from a resource-rich source domain to a resource-poor target domain. Specifically, since most existing transfer learning methods only focus on learning a shared feature space across domains while ignoring the relationship between the source and target domains, we propose to simultaneously learn shared representations and domain relationships in a unified framework. Furthermore, we propose an efficient and effective hybrid model by combining a sentence encoding-based method and a sentence interaction-based method as our base model. Extensive experiments on both paraphrase identification and natural language inference demonstrate that our base model is efficient and has promising performance compared to the competing models, and our transfer learning method can help to significantly boost the performance. Further analysis shows that the inter-domain and intra-domain relationship captured by our model are insightful. Last but not least, we deploy our transfer learning model for PI into our online chatbot system, which can bring in significant improvements over our existing system. Finally, we launch our new system on the chatbot platform Eva in our E-commerce site AliExpress. |
format |
text |
author |
YU, Jianfei QIU, Minghui JIANG, Jing HUANG, Jun SONG, Shuangyong CHU, Wei CHEN, Haiqing |
author_facet |
YU, Jianfei QIU, Minghui JIANG, Jing HUANG, Jun SONG, Shuangyong CHU, Wei CHEN, Haiqing |
author_sort |
YU, Jianfei |
title |
Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce |
title_short |
Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce |
title_full |
Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce |
title_fullStr |
Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce |
title_full_unstemmed |
Modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce |
title_sort |
modelling domain relationships for transfer learning on retrieval-based question answering systems in e-commerce |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2018 |
url |
https://ink.library.smu.edu.sg/sis_research/3964 https://ink.library.smu.edu.sg/context/sis_research/article/4966/viewcontent/p682_yu.pdf |
_version_ |
1770574059984125952 |