Multi-head attention graph convolutional network model: End-to-end entity and relation joint extraction based on multi-head attention graph convolutional network

• Main Authors: TAO, Zhihua, OUYANG, Chunping, LIU, Yongbin, CHUNG, Tonglee, CAO, Yixin
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Information retrieval; Natural language processing; Artificial Intelligence and Robotics; Programming Languages and Compilers
• Online Access: https://ink.library.smu.edu.sg/sis_research/9347; https://ink.library.smu.edu.sg/context/sis_research/article/10347/viewcontent/CAAI_Trans_on_Intel_Tech___2022___Tao___Multi_head_attention_graph_convolutional_network_model_End_to_end_entity_and.pdf
• Institution: Singapore Management University

At present, the entity and relation joint extraction task has attracted more and more scholars' attention in the field of natural language processing (NLP). However, most of their methods rely on NLP tools to construct dependency trees to obtain sentence structure information. The adjacency matrix constructed by the dependency tree can convey syntactic information. Dependency trees obtained through NLP tools are too dependent on the tools and may not be very accurate in contextual semantic description. At the same time, a large amount of irrelevant information will cause redundancy. This paper presents a novel end-to-end entity and relation joint extraction based on the multi-head attention graph convolutional network model (MAGCN), which does not rely on external tools. MAGCN generates an adjacency matrix through a multi-head attention mechanism to form an attention graph convolutional network model, uses head selection to identify multiple relations, and effectively improve the prediction result of overlapping relations. The authors extensively experiment and prove the method's effectiveness on three public datasets: NYT, WebNLG, and CoNLL04. The results show that the authors' method outperforms the state-of-the-art research results for the task of entities and relation extraction.