Improving multimodal named entity recognition via entity span detection with unified multimodal transformer

• Main Authors: YU, Jianfei, Jing JIANG, YANG, Li, XIA, Rui
• 格式: text
• 語言: English
• 出版: Institutional Knowledge at Singapore Management University 2020
• 主題: Databases and Information Systems; Theory and Algorithms
• 在線閱讀: https://ink.library.smu.edu.sg/sis_research/5272; https://ink.library.smu.edu.sg/context/sis_research/article/6275/viewcontent/8._Improving_Multimodal_Named_Entity_Recognition_via_Entity_Span_Detection_with_United_Multimodal_Transformer__ACL2020_.pdf

In this paper, we study Multimodal Named Entity Recognition (MNER) for social media posts. Existing approaches for MNER mainly suffer from two drawbacks: (1) despite generating word-aware visual representations, their word representations are insensitive to the visual context; (2) most of them ignor...