ngram-OAXE: Phrase-based order-agnostic cross entropy for non-autoregressive machine translation

• Main Authors: DU, Cunxiao, TU, Zhaopeng, WANG, Longyue, JIANG, Jing
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/7616; https://ink.library.smu.edu.sg/context/sis_research/article/8619/viewcontent/2022.coling_1.446.pdf
• Institution: Singapore Management University

Recently, a new training oaxe loss has proven effective to ameliorate the effect of multimodality for non-autoregressive translation (NAT), which removes the penalty of word order errors in the standard cross-entropy loss. Starting from the intuition that reordering generally occurs between phrases,...