Revisiting the Markov Property for machine translation

• المؤلفون الرئيسيون: DU, Cunxiao, ZHOU, Hao, TU, Zhaopeng, JIANG, Jing
• التنسيق: text
• اللغة: English
• منشور في: Institutional Knowledge at Singapore Management University 2024
• الموضوعات: Numerical Analysis and Scientific Computing
• الوصول للمادة أونلاين: https://ink.library.smu.edu.sg/sis_research/8725; https://ink.library.smu.edu.sg/context/sis_research/article/9728/viewcontent/2024.findings_eacl.40_pvoa.pdf
• المؤسسة: Singapore Management University

In this paper, we re-examine the Markov property in the context of neural machine translation. We design a Markov Autoregressive Transformer (MAT) and undertake a comprehensive assessment of its performance across four WMT benchmarks. Our findings indicate that MAT with an order larger than 4 can ge...