Topical co-attention networks for hashtag recommendation on microblogs

• Main Authors: LI, Yang, LIU, Ting, HU, Jingwen, JIANG, Jing
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2019
• Subjects: Hashtag recommendation; Long short-term memory; Co-attention; Topic model; Computer Engineering; Programming Languages and Compilers
• Online Access: https://ink.library.smu.edu.sg/sis_research/4900; https://ink.library.smu.edu.sg/context/sis_research/article/5903/viewcontent/topical__PV.pdf
• Institution: Singapore Management University

Hashtags provide a simple and natural way of organizing content in microblog services. Along with the fast growing of microblog services, the task of recommending hashtags for microblogs has been given increasing attention in recent years. However, much of the research depends on hand-crafted features. Motivated by the successful use of neural models for many natural language processing tasks, in this paper, we adopt an attention based neural network to learn the representation of a microblog post. Unlike previous works, which only focus on content attention of microblogs, we propose a novel Topical CoAttention Network (TCAN) that jointly models content attention and topic attention simultaneously, in the sense that the content representation(s) are used to guide the topic attention and the topic representation is used to guide content attention. We conduct experiments and test with different settings of TCAN on a large real-world dataset. Experimental results show that our model significantly outperforms various competitive baseline methods. Furthermore, the incorporation of topical co-attention mechanism gives more than 13.6% improvement in F1 score compared with the standard LSTM based methods.