COSY: COunterfactual SYntax for cross-lingual understanding

• Main Authors: YU, Sicheng, ZHANG, Hao, NIU, Yulei, SUN, Qianru, JIANG, Jing
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2021
• Subjects: Computational linguistics; Natural language processing systems; Semantics; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/6510; https://ink.library.smu.edu.sg/context/sis_research/article/7513/viewcontent/2021.acl_long.48.pdf
• Institution: Singapore Management University

Pre-trained multilingual language models, e.g., multilingual-BERT, are widely used in cross-lingual tasks, yielding the state-of-the-art performance. However, such models suffer from a large performance gap between source and target languages, especially in the zero-shot setting, where the models ar...