Diffusion models for natural language processing

• Main Author: Hoang, Minh Nhat
• Other Authors: Luu Anh Tuan
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2024
• Subjects: Computer and Information Science; Natural language processing
• Online Access: https://hdl.handle.net/10356/174904
• Institution: Nanyang Technological University

The autoregressive method has long been fundamental in natural language processing (NLP), where models predict the next token based on previously generated context. While effective, this approach suffers from inherent limitations, including slow generation speed and sequential dependency, hindering...